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PRECIS 

RESEARCH  PROGRESS  REPORT 


Title:  "Annual  Report:  Automatic  Informative  Abstracting  and  Extracting,"  Annual 
Progress  Report,  Office  of  Naval  Research,  Contract  Nonr  4440(00). 

Authors:  L.  L.  Earl  and  H.  R.  Robison 

Background;  This  investigation  is  concerned  with  the  development  of  automatic  index¬ 
ing,  abstracting,  and  extracting  systems.  Basic  investigations  in  English  morphology, 
phonetics,  and  syntax  have  been  pursued  as  necessary  means  to  this  end.  Experi¬ 
mental  indexing  and  extracting  systems  are  new  being  developed. 

Condensed  Report  Contents;  The  fifth  annual  report  on  automatic  abstracting  and 
extracting  summarizes  progress  in  two  areas  of  investigation:  (1)  the  use  of  syntactic 
information  in  automatic  indexing  and  extracting  and  (2)  compilation  of  a  "word  govern¬ 
ment"  dictionary  of  English  words  and  their  associated  government  patterns.  Within 
the  first  area,  three  e3q)eriments  were  pursued;  (1)  development  of  a  "sentence  dic¬ 
tionary"  for  use  in  automatic  extracting,  (2)  combination  of  frequency  and  syntactic 
criteria  in  automatic  extracting,  and  (3)  development  of  a  detailed  index  of  highly 
specialized  text.  For  the  "sentence  cictionary,"  a  3216-sentence  data  base  was  hand- 
processed  to  assign  a  significance  code  (I  for  indexible  and  N  for  nonindexible)  to 
each  sentence  on  the  basis  of  the  back-of-the-book  index.  Parts  of  the  data  base  were 
then  automatically  processed  to  assign  a  phrase  structure  to  the  sentences.  When  all 
of  the  data  base  has  been  so  processed,  a  study  of  the  correlation  between  the  phrase 
structure  and  the  significance  code  will  be  made.  In  tlio  extracting  experiment,  the 
star  ting  point  was  again  sentences  which  had  been  automatically  assigned  a  phrase 
structure.  An  algorithm  was  developed  and  programmed  to  choose  sentences  from  the 
text  on  the  basis  of  frequency,  syntactic,  and  combinational  considerations.  Words 
are  selected  from  the  text  on  a  a3mtactic  basis  and  a  frequency  count  of  these  words  is 
made.  This  frequency  count  forms  the  basis  of  a  further  selection  of  words.  Finally, 
combinations  of  the  remaining  words  determine  the  choice  of  sentences  to  be  included 
in  the  extract.  Four  chapters  from  four  technical  books  were  so  proi,3ssed  and  the 
results  partially  evaluated.  In  the  Indexing  e:qpertment,  all  noun  phrases  were  ex¬ 
tracted  from  the  text.  These  noun  phrases  were  used  as  index  items,  and  were  also 
oroken  up,  combined,  or  reordered  in  some  cases,  to  produce  a  very  comprehensive 
list  of  index  terms.  The  entire  book  Current  Medical  Terminology  was  so  processed 
and  the  resulting  index  loaded  into  a  retrieval  system  for  testing.  The  compilation  of 
the  word-government  dictionary  continued.  Several  hundred  new  entries  were  added 
to  the  D-L  portion  of  the  dictionary.  In  addition,  all  the  secondary  patterns  of  the  D-L 
portion  of  the  dictionary  have  been  re-examined  and,  where  necessary,  altered  to 
accommodate  the  fact  that  semantics  and  government  pattern  may  be  correlated.  Thus 
the  A-L  portion  of  the  dictionary  is  now  a  syntactic-semantic  dictionary.  The  ftict  that 
a  word's  government  patterns  and  varioijs  semantic  meanings  can  be  correlated  con¬ 
tinues  to  be  one  of  the  most  interesting  aspects  of  the  project.  To  fully  accommodate 
the  phenomena,  new  secondary  categories  are  being  incorporated  into  the  government 
patterns  where  required  (i.e. ,  animate  nouns,  reflexive  pronouns). 

For  Further  Information;  The  complete  report  is  available  in  the  major  Navy  technical 
libraries  and  can  be  obtained  from  the  Defense  Documentation  Center.  A  few  copies  are 
available  for  distribution  by  the  authors. 
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This  report  marks  the  completion  of  the  fifth  year  in  which  the  Office  of  Naval  Research 
has  contributed  si5)port  to  research  in  the  Information  Sciences  at  the  Lockheed  Palo 
Alto  Research  Laboratory  of  the  Lockheed  Missiles  &  Space  Company.  During  the 
first  y  ^ar  of  the  program,  a  major  part  of  the  effort  went  into  establishment  of  a  wr  ^’d- 
data  base.  The  English  Word  Speculum,  which  has  been  distributed  to  ONR  program 
participants,  illustrates  the  nature  of  this  data  base.  In  the  second  and  thiid  year, 
this  data  base  was  exploited  in  the  development  of  a  computer  program  for  the  auto¬ 
matic  assignment  of  parts  of  speech  to  English  words.  Also  during  these  years,  it  was 
demonstrated  how  an  English/Russian  phrase  data  base  can  be  used  to  develop  a  tech¬ 
nique  for  obtaining  En^ish  indexes  from  untranslated  Russian  text.  In  the  third  and 
fourth  years,  a  new  data  base  of  sentences  with  assigned  parts  of  speech  was  created 
for  investigation  of  the  abstracting  and  extracting  process.  During  the  third  and  fourth 
years,  compilation  of  English  word  government  tables  began,  and  this  activity  has 
continued  in  the  fifth  year.  Also  during  this  year,  a  new  approach  to  the  ’’sentence 
dictionary"  has  been  investigated,  utilizing  a  newly  developed  parsing  program  which 
has  also  proved  useful  in  indexing  and  extracting  experiments. 

Part  I  of  this  report  documents  the  phrase  structure  approach  to  the  sentence  dictionary, 
extracting  ejq)eriments  on  some  technical  books,  and  an  automatic  indexing  of  a  medical 
book  for  retrieval  purposes.  Part  11  describes  the  notion  of  word -government,  dis¬ 
cusses  the  phenomenon  of  semantics  and  word  government,  and  finally  lists  the  entries 
compiled  to  date. 

The  group  at  Lockheed  takes  this  opportunity  to  e>q)A  ss  its  thanks  for  the  continuing 
sipport  and  encouragement  given  by  the  Information  Sciences  Branch  of  the  Office  of 
Naval  Research. 
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Section  1 

BACKGROUND  AND  THEORY 

1.1  PHRASE  STRUCTURE  IN  "SENTENCE  DICTIONARY"  EXTRACTING 

It  would  be  very  convenient  for  automatic  extracting  if  a  relationship  existed  between 
the  syntactic  structure  of  a  sentence  and  its  significance  or  usefulness  in  forming  an 
extiract.  This  would  be  particularly  true  if  a  "sentence  dictionary,"  a  dictionary  of 
syntactic  sentence  types,  could  be  compiled  and  then  a  separation  of  significant  from 
nonsignificant  sentences  could  be  accomplished  on  the  basis  of  these  sentence  types. 

To  test  such  a  possibility,  an  experiment  was  devised  for  building  a  trial  sentence 
dictionary  using  part-o£-speech  strings  to  characterize  a  sentence  syntactically,  and 
a  previously  formed  index  to  establish  whether  a  sentence  was  to  be  considered  signifi¬ 
cant  or  not.  This  experiment  Is  described  and  documented  in  two  previous  annual 
reports  (Refs.  1,2).  The  results  will  be  summarized  in  the  following  paragraphs  as 
background  for  the  continuing  sentence  dictionary  experiment. 

According  to  the  sentence  dictionary  hypothesis,  a  large  group  of  sentences,  as  repre¬ 
sentative  of  the  language  as  possible,  are  to  be  processed,  classified  as  "indexible" 
or  "nonindexible,"  and  assigned  a  syntactic  structure.  The  hope  is  that  when  these 
structures  are  sorted  or  ordered,  it  will  be  found  that  like  structures  have  like  index 
classifications.  If  this  is  so,  and  if  there  are  not  too  many  different  structures  pos¬ 
sible  in  the  language,  the  structures  can  be  ordered  into  a  "dictionary"  of  sentence 
types,  each  classified  as  indexible  or  nonindexible,  so  that  when  other  sentences  are 
assigned  a  sentence  structure,  a  dictionary  lookiq)  can  be  used  to  classify  them  as 
indexible  or  nonindexible.  (The  dictionary  really  need  contain  sentence  types  of  only 
one  classification,  either  all  indexible  or  all  nonindexible  sentences.) 
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Testing  of  the  validity  of  the  sentence  dictionary  hypothesis  boils  down  to  answering 
two  questions: 

•  Is  there  a  system  of  S3mtactic  classification  which  will  separate  indexible 
from  nonindexible  sentences? 

•  Does  such  a  system  produce  a  manageable  number  of  sentence  types  ? 

In  the  compilation  of  a  trial  sentence  dictionary,  several  derivative  and  interrelated 
quv  'tions  had  to  be  faced  immediately. 

•  What  sentences  can  be  used  as  a  data  base  in  constructing  a  '.entence 
dictionary? 

•  How  should  sentences  be  identified  as  indexible  or  nonindexible? 

•  What  method  of  syntactic  classification  should  be  tried? 

•  How  many  sentences  must  be  used  in  the  data  base  in  forming  the  sentence 
dictionary  so  that  all,  or  nearly  all,  English  syntactic  types  will  be 
represented? 

The  initial  answers  to  these  questions  need  not  be  the  final  answers.  The  ejqperiment, 
in  fact,  consists  of  working  to  arrive  at  optimum  practical  answers  to  these  questions 
so  that  the  validity  of  the  sentence  dictionary  hypothesis  can  be  evaluated,  rhe  follow¬ 
ing  paragraphs  give  the  answers  adopted  for  the  initial  experiment. 

•  What  sentences  can  be  used  as  a  data  base  in  constructing  a  sentence  dictionary? 
The  sentence  dictionary  hypothesis  depends  on  the  further  hypothesis  that  well- 
formed  English  sentences  in  scientific  exposition  follow  a  finite  number  of  syntactic 
patterns,  which  will  occur  repeatedly  in  text,  so  that  if  enough  text  is  examined, 

Ihe  patterns  will  emerge.  Thus  the  question  concerning  the  number  of  sentences 
to  be  chosen  becomes  more  Important  than  the  sentence  source,  although  it  seems 
obvious  that  the  more  diverse  the  sample,  the  more  economically  the  objective  can 
be  met.  To  choose  text  for  the  initial  e3q)eriment,  books  were  picked  at  random 
from  the  Palo  Alto  Library  of  the  LMSC  Technical  Information  Center,  and  one 
chapter  was  used  from  each  book.  It  was  hoped  that  different  books  would  reflect 
different  styles,  and  that  using  the  running  text  from  one  chapter  would  give  a 
representative  sample  of  the  construction  used  by  that  author. 
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•  How  are  sentences  to  be  identified  as  iadeadble  or  nonlndcadble?  Since  books  are 
usually  published  with  an  index,  and  these  indexes  have  long  been  accepted  by  the 
public,  it  seemed  simplest  to  begin  by  using  these  indexes  in  distinguishing  which 
sentences  were  to  be  regarded  as  signiHcant  and,  therefore,  which  sentence  types 
were  to  go  into  the  sentence  dictionary  as  indexible.  Sentences  were  designated 
indexible  if  they  contained  a  phrase  listed  in  the  index,  and  nonindexible  if  they  did 
not.  The  dif&culties  encountered  in  making  such  a  designation  are  discussed  on 
pages  1-5  and  1-6  of  Hef.  1. 

•  How  are  sentences  to  be  syntactically  classified?  It  seemed  reasonable  to  begin  by 
classifying  sentences  into  as  fine  a  classiHcation  as  possible,  because  the  finer 
the  syntactic  classification  and  the  larger  the  number  of  syntactic  sentence  types, 
the  greater  the  chance  that  a  partition  into  indexible  and  nonindexible  fypes  can  be 
made.  Therefore,  the  sentences  were  initially  characterized  as  a  string  of  part- 
of-speech  possibilities.  Because  dictonary  lookig)  of  woi^  is  costly,  a  study  of 
the  graphemic  form  of  words  was  made,  and  an  algorithm  was  devised  to  assign 
part-of-speech  codes  to  words  automatically  (Ref.  3).  Figure  1  in  Ref.  2  shows 
sentences  with  their  assigned  part-of-speech  strings. 

•  How  many  sentences  must  be  used  in  forming  the  sentence  dictionary?  Unfortu¬ 
nately,  this  question  and  the  third  question,  how  the  sentences  are  to  be  syntacti¬ 
cally  classified,  are  interrelated.  The  number  of  sentences  which  must  be 
processed  in  order  to  encounter  nearly  all  syntactic  types  depends  on  the  system 
of  syntactic  classification  used,  and  the  practicalify  of  a  syntactic  classification 
system  depends  on  the  number  of  sentence  types  produced  by  the  classification 
system.  As  with  the  other  questions,  the  answer  is  really  to  a  large  extent  the 
object  of  the  e^riment,  but  always  there  must  be  a  starting  place.  Nine  chapters 
from  nine  texts,  listed  in  Ref.  1,  were  used  in  the  initial  e^riment;  this  sample 
of  3, 216  sentences  was  thought  sufficient  to  indicate  the  further  directions  in  which 
the  e;)q}eriment  should  proceed. 
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The  results  of  the  initial  sentence  dictionary  experiment  are  detailed  in  Section  2  of 
Ref.  2.  From  these  results  it  became  clear  that  representing  a  sentence  by  part- 
of-speech  strings  makes  too  Rne  a  distinction  between  sentences.  Nearly  all  the 
sentences  of  the  data  base  (3064  out  of  3216)  had  a  unique  part-of-speech  pattern. 
Obviously,  another  method  of  classifying  sentences  had  to  be  chosen  to  decrease  the 
total  number  of  sentence  types  and  to  increase  the  probability  of  diq)licate  types.  It 
was  decided  to  try  classifying  the  sentences  according  to  their  phrase  structure,  with 
the  hope  that  there  would  be  a  significant  number  of  sentences  of  like  phrase  structure. 
To  do  this,  it  was  necessary  to  develop  an  algorithm  for  automatic  syntactic  analysis, 
based  on  a  phrase -structure  grammar.  The  syntactic  analysis  algorithm  developed 
was  based  on  the  needs  of  this  sentence  dictionary  application  and  of  two  other  appli¬ 
cations,  described  in  subsections  1.2  and  1.3.  In  all  three  applications,  identification 
of  noun  and  verb  phrases  was  of  primary  importance;  the  need  for  identification  of 
higher  level  structures  (such  as  participial  and  prepositional  phrases  and  clauses)  and 
of  modification  patterns  had  not  yet  been  established.  Since  the  identification  of  noun 
and  verb  phrases  and  infinitives  is  basic,  is  a  large  part  of  the  parsing  process,  and 
is  necessary  for  higher  level  analysis,  it  was  decided  to  limit  the  first  parsing  efforts 
to  identification  of  these  elements  and  to  resolution  of  the  role  of  participles  in  the 
sentence. 

For  the  sentence  dictionary  application,  then,  a  sentence  would  be  represented  by  (or 
mapped  into)  a  string  Ox  phrases,  with  the  parts  of  speech  of  structural  words  inter¬ 
spersed.  For  example,  consider  the  sentence  "However,  most  standards  serve  also 
to  lift  the  plane  of  competition."  The  parsing  program  should  recognize  the  noun 
phrases  "most  standards,"  "the  plane,"  and  "competition;"  the  verb  phrase  "serve 
also;"  and  the  infinitive  "to  lift."  It  should  then  map  the  structure  of  the  sentence  as 
shown  in  Fig.  1. 

This  year's  progress  in  parsing  and  in  its  use  in  the  "sentence  dictionary"  application 
is  given  in  subsections  2. 1  aiid  2.2. 
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Word 


Structural  Element 


However 

> 

most  standards 
serve  also 
to  lift 
the  plane 
of 

competition 


adverb 
punctuation 
noun  phrase 
verb  phrase 
infinitive  (phrase) 
noun  phrase 
preposition 
noun  phrase 


Fig.  1  Example  of  Structural  Elements 
Identified  by  BPHRAS 


1. 2  PHRASE  STRUCTURE  IN  FREQUENCY-SYNTAX  EXTRACTING  OR  INDEXING 


In  1965,  a  method  was  developed  to  identify  index  items  by  combining  syntactic  and 
statistical  criteria.  This  is  described  briefly  in  the  March  1966  Annual  Report 
(Ref.  4)  and  the  results  on  five  text  excerpts  are  shown  in  that  reference.  Although 
these  results  were  promising,  further  tests  were  not  possible  because  of  the  e^qpense 
of  running  an  elaborate  parsing  program  on  the  IBM  7094. 

In  the  1965-1966  experiments,  the  data  corpus  was  reduced  by  selecting  only  certain 
structural  items  (subjects,  objects  of  verbs  and  infinitives,  with  genitive  modifiers), 
and  this  new  corpus  was  subjected  to  statistical  counts.  An  algorithm  was  developed, 
which,  on  the  basis  of  these  counts,  chose  certain  words  for  a  first-level  index. 

Then  all  larger  structural  items  containing  these  words  were  included  in  a  second- 
level  index. 


In  reviewing  this  work,  it  was  thought  that  a  simpler  parsing  program,  such  as  that 
developed  for  the  sentence  dictionary  ejq)eriment,  might  be  adequate  for  indexing  or 
extracting  purposes,  and  yet  be  much  faster  and  more  reliable  than  the  complete 
analyzer.  The  new  experiments  were  to  be  patterned  in  general  after  the  1966 
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experiments,  but  were  to  aim  toward  an  extract  rather  than  an  index.  Progress  in 
the  development  of  such  an  algorithm  is  discussed  in  subsection  2. 3. 

1.3  PHRASE  STRUCTURE  IN  SPECIAUZED  INDEXING  PROCEDURES 

There  are  certain  specialized  texts  in  which  information  is  tightly  packed  for  which  a 
very  detailed  or  thorough  or  deep  index  is  needed  for  use  in  an  information  retrieval 
system.  For  such  an  index,  reduction  of  the  size  of  the  index  file  may  not  be  a  goal 
at  all.  Thorough  coverage  is  the  objective.  A  parsing  program  such  as  that  developed 
for  the  sentence  dictionary  experiment  is  useful  for  formiilating  such  an  index  by  virtue 
of  its  ability  to  isolate  noun  phrases  h-om  the  verbs  and  structural  words  in  the  sen¬ 
tence.  Each  noun  phrase  represents  a  basic  thought  to  enter  in  the  index,  and  then 
the  words  of  the  noun  phrase  can  be  separated  or  permeated  to  give  other  index 
entries. 

The  testing  of  this  idea  on  an  AMA -published  listing  of  diseases  and  their  character¬ 
istics  is  described  in  subsection  2. 4. 
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Section  2 

1968-1969  PROGRESS 

2. 1  SYNTACTIC  ANALYSIS  PROGRAM 

The  BPHRAS  syntactic  analyzer,  which  was  described  and  documented  in  last  year's 
annual  report  (Ref.  2),  will  be  redocumented  in  this  report  (subsection  3. 1)  because 
substantial  changes  and  additions  have  been  made  in  the  interim.  The  changes  have 
resulted  from  more  extensive  testing  of  the  parsing  algorithm  and  the  computer  pro¬ 
gram  which  implements  it.  They  are  discussed  in  this  section.  The  additions  result 
from  the  development  of  an  extracting  technique  utilizing  syntactic  information.  This 
technique  and  the  necessary  additions  to  BPHRAS  are  discussed  in  subsection  2.3. 

If  Ref.  2  is  not  readily  available,  a  brief  description  of  the  function  of  the  BPHRAS 
parser  or  syntactic  analyzer  is  found  in  subsection  1. 1  of  this  report.  No  changes  in 
the  puipose  or  function  of  BPHRAS  have  been  made.  The  changes  reflect  a  refining 
of  the  methods  of  resolving  structural  ambiguities.  For  example,  an  original  rule  in 
the  identification  of  infinitives  stated  that  in  the  case  of  both  a  possible  noun  phrase 
and  a  possible  verb  phrase  following  the  word  "to,"  xmless  the  first  word  of  the  noun 
phrase  was  a  plural  noun,  an  infinitive  was  to  be  defined  from  "to"  through  the  verb 
phrase,  and  the  noun  phrase  was  to  be  shortened  or  eliminated  accordingly.  For 
example: 


VBP*  VBP* 

I - 1  ( - 1 

to  ^  support  good  schools  ^ 
NAP* 


is 


resolved  to  be 


NI’P  NAP 


to  siqjport  good  schools 
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This  rule  has  now  been  amended  so  that  if  the  verb  phrase  possibility  is  followed  by 
an  unambiguous  conjunction  and  another  verb  phrase  possibility,  an  infinitive  will  be 
defined  thro<j^  the  second  verb  phrase.  For  example: 

VBP*  VBP* 

I - 1  I - 1  I - 1 

to  help  and  siq>port  the  &mily 

I _ I  I _ I  I _ I 

NAP*  NAP*  NAP* 

is  resolved  to  be 

NFP  NAP 

*  to  help  and  sipport  '  'the  family' 

The  testing  of  the  rules  began  in  1967—1968  and  was  continued  through  the  first  half 
of  1968-1969,  with  three  objectives  in  mind: 

(1)  Eliminate  all  program  errors 

(2)  Locate  the  words  commonly  in  the  data  base  which  are  assigned  the  wrong 
part-of-speech  possibilities  by  the  POS  program ,  so  that  these  could  be  put 
in  a  special  dictionary 

(3)  Eliminate  as  many  of  the  weaknesses  in  the  rules  as  possible 

As  the  tests  were  continued,  the  data  set  was  gradually  increased.  SUnce  a  change  in 
one  part  of  the  program  may  affect  another  part,  each  set  of  changes  should  be  tested 
on  the  entire  data  set.  Therefore,  each  cycle  of  improvements  was  more  time  con¬ 
suming,  and  the  rule  of  diminishing  returns  was  encountered.  In  general,  as  the 
accuracy  of  the  assigned  structure  increases,  the  errors  are  found  in  more  and  more 
obscure  or  difficult  areas  of  Ei^lish  grammar  and  the  difficulty  of  correction  in¬ 
creases.  The  accuracy  objective  was  set  at  97%;  that  is,  a  3%  error  rate  was  to  be 
allowed.  The  error  percentage  was  calculated  by  dividing  the  number  of  incorrect 
elements  in  the  phrase  structure  strings  by  the  total  number  of  elements.  Work  was 
terminated  when  this  goal  was  met  for  a  total  group  of  about  175  sentences,  actually 
tested  in  several  separate  runs. 


2-2 


LOCKHEED  PALO  ALTO  RESEARCH  LABORATORY 

LOCKHEED  MISSILES  I.  S^ACE  COMPANY 
A  0«0UP  DIVISION  OF  LOCKHEED  A  I • CD  A F  I  COlPOEATION 


I 


I 


i 


3 

8r» 

[ 


2.2  THE  "SENTENCE  DICTIONARY"  EXPERIMENT 


Since  the  part-of-speech  strings  proved  to  be  an  inadequate  syntactic  representation 
of  a  sentence,  for  sentence  dictioriary  purposes  it  was  decided  to  use  a  simple 
phrase  structure  representation  (See  subsection  1.1.)  As  soon  as  the  BPHRAS 
program  for  assigning  such  a  structure  had  reached  a  satisfactory  point  in  the  devel¬ 
opment  (subsection  2.1),  five  of  the  chapters  in  the  data  base  were  processed  and  the 
phrase  structure  of  the  sentences  was  stored  on  magnetic  tape. 


To  discover  the  degree  of  diplication  of  structures  among  these  sentences,  or  others 
in  the  data  base,  two  more  computer  programs  were  needed.  The  first  of  these  would 
sort  files  or  files  of  sentences  so  that  sentences  of  like  phrase  structure  are  together. 
The  second  would  examine  contiguous  sentences  and  print  out  sentences  with  an  exact 
diplication  of  phrase  structure.  The  first  of  thvese  programs  has  been  written  as  a 
set  of  control  cards  for  the  IBM  generalized  SORT  routine,  and  these  cards  are  listed 
in  the  documentation  (subsection  3.2).  Since  the  sentences  are  variable  in  length,  the 
sentence  records  output  ty  BPHRAS  are  also  variable  in  length.  To  cover  the  longer 
sentences,  the  length  of  ihe  field  upon  which  the  sort  is  to  be  made  is  set  at  100  bytes, 
which  means  that  the  field  will  extend  into  the  EBCDIC  representation  of  the  sentence 
for  many  sentences  and  will  actually  extend  beyond  the  record  length  for  some. 

Although  nothing  in  the  SORT  manual  indicates  whether  or  not  this  will  interfere  with 
the  SORT,  it  has  worked  satisfactorily.  It  does  mean,  however,  that  on  occasion 
sentences  of  like  structure  are  separated  because  the  SORT  program  cannot  distinguish 
the  EBCDIC  from  the  phrase  structure  sections.  For  example,  see  the  arrangement 
below: 


(1)  NAP  VBP  PU  KILROY  WAS  HERE. 

(2)  NAP  VBP  PU  NAP  PU  THERE  WERE, . . . 

(3)  NAP  VBP  PU  VERY  FEW  CAN  DECIDE. 


In  such  a  case,  the  program  which  checks  for  exact  duplication  will  miss  the  diq)lica- 
tion  of  (1)  and  (3).  For  the  moment,  this  problem  will  be  ignored  because  it  can 
result  at  the  very  worst  only  in  the  loss  of  the  diq>licate  preceding  and  following  the 
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intervening  sentence.  If  the  sentences  preceding  and  following  (3)  are  of  the  same 
structure,  none  of  the  sentences  will  be  lost. 


The  second  program,  for  selecting  and  printing  duplicate  phrase  structures,  is  an 
adaptation  of  the  program  DUPPOS  which  extracts  and  prints  sentences  with  diQ)licate 
part-of-speech  strings.  This  program,  DUPPHRAS,  is  in  checkout.  In  the  midst  of 
the  checkout,  it  has  been  decided  to  extend  the  scope  of  DUPPHRAS  to  check  for  and 
omit  from  the  printout  any  sentences  whose  phrase  structure  and  words  are  both 
identical. 

The  five  chapters  processed  by  BPHRAS  have  been  sorted  together.  DUPPHRAS  will 
be  run  to  extract  duplicate  phrase  structures.  This  oulput  wHl  be  checked  for  the 
prevalence  and  extent  of  dtplicated  sentence  patterns  and  the  degree  of  consistency 
of  index  codes  within  a  given  sentence  pattern.  Then  the  remaining  four  chapters  will 
be  processed  by  BPHRAS  and  added  to  the  sorted  file.  DUPPHRAS  will  again  extract 
dvplicate  phrase  structures  so  that  the  results  for  5  and  9  texts  can  be  compared  and 
the  possible  utility  of  a  phrase-structure  dictionary  evaluated. 

2. 3  FREQUENCY-SYNTAX  EXTRACTING  EXPERIMENT 

2.3.1  General  Principles 

Upon  reviewing  the  1965  work  on  using  syntactic  and  frequency  criteria  to  form  a 
two-lev^l  index  (subsection  1.2),  it  was  decided  that  a  similar  but  simpler  scheme 
might  be  used  to  produce  an  automatic  extract.  Producing  an  extract  was  an  attractive 
idea  because  it  seemed  feasible  to  produce  an  extract  which  would  adequately  reflect 
the  content  and  which,  unlike  the  automatic  index,  would  not  require  human  editing. 

The  first  e^eriment  required  five  steps,  each  of  which  required  some  programming. 

(1)  All  the  nouns  in  the  text  were  to  be  extracted  with  the  number  of  the  sentence 
from  which  they  came,  to  form  a  list  of  word  and  sentence -number  entries. 


2-4 


LOCKHEED  PALO  ALTO  RESEARCH  LABORATORY 

lOCKHCED  MISSIIES  &  SEACE  COMPANY 
A  G90{iP  DIVISION  Of  lOCKMEiD  A  I  «  CK  A  M  COlPORATlON 


(2)  This  list  was  to  be  sorted  alphabetically  on  the  word  part  of  the  entry. 

(3)  A  frequency  count  of  the  words  was  to  be  calculated  and  the  words  ordered 
tiy  their  frequency.  Then  all  words  with  a  frequency  below  a  calculated 
cutoff  frequency  were  to  be  discarded. 

(4)  The  remaining  list  was  to  be  sorted  on  the  sentence  number  part  of  the 
entry. 

(5)  An  extract  was  to  be  formed  and  printed  according  to  an  algorithm  whose 
iiq)ut  was  to  be  the  ordered  words  from  step  (4)  and  the  SENDIC  output  of  the 
processing  of  the  original  text,  in  original  sentence  number  order. 

For  step  (1),  an  addition  was  made  to  BPHRAS  so  that,  as  each  sentence  was  output 
with  its  phrase  structure,  each  nontrivial  word  of  each  noim  phrase  was  output  onto 
disk  with  the  sentence  identification.  The  necessary  additions  are  documented  in  the 
ne\  BPHRAS  flow  diagram,  subsection  3.1.  In  step  (2),  the  reordered  list  of  words 
is  stored  on  magnetic  tape,  from  which  it  is  referenced  for  steps  (3),  (4),  and  (5). 

Steps  (2)  and  (4)  are  implemented  by  using  the  IBM  SORT  program;  control  cards  are 
given  in  subsection  3.4.  Step  (3)  required  a  new  program,  EXTRACT,  documented  in 
subsection  3.3,  and  step  (5)  a  new  program,  PRNTEXT,  documented  in  subsection  3.5. 

2,3.2  Original  Algorithm 

Of  the  five  extracting  steps,  the  crucial  ones  are  (3)  and  (5),  and  these  are  the  steps 
which  have  been  subject  to  e}q)erimental  change.  The  original  algorithm  for  step  (3) 
was  as  follows. 

The  frequency  count  of  each  word  on  the  list  from  step  (2)  is  calculated  and  stored 
(COUNT  table),  along  with  the  position  of  the  first  occurrence  of  the  word  in  the  tape 
file.  The  frequency  counts  are  then  ordered  (descending  order)  and  the  difference 
from  one  ^'roquency  count  to  the  next  is  calculated  and  stored  (DIFF  table)  with  the 
addresr  in  the  COUNT  table  of  the  higher  frequency.  The  percent  of  each  frequency 
count  of  the  total  of  all  frequency  coui'.ts  is  calculated  and  stored  (PERCENT  TABLE) 
with  the  cumulative  percent  and  the  address  of  the  frequency  count  in  the  COUNT  table. 
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Four  points  in  the  COUNT  table  are  then  calculated  and  from  these  the  cutoff  point  is 
chosen. 

•  Point  A  -  Point  at  which  the  cumulative  percent  is  less  than  or  equal  to  an 
arbitrary  value  VI 

•  Point  B  -  Point  at  which  the  largest  difference  in  frequencies  occurs 

•  Point  C  -  Point  at  which  the  largest  difference  below  B  occurs 

•  Point  D  -  Point  at  which  the  frequency  value  is  equal  to  or  just  above  the 

largest  frequency  divided  by  2 

The  four  points  are  then  ordered  in  descending  order.  The  second  point  is  taken  as 
the  cutoff  point  if  that  point  has  a  cumulative  percent  less  than  an  arbitrary  value  V2 . 

If  not,  then  the  third  point  is  taken  if  it  has  a  cumulative  percent  less  than  V2 .  If  not, 
the  fourth  point  is  selected.  All  entries  ir.  the  COUNT  table  with  frequencies  below 
the  selected  point  are  eliminated;  then  the  retained  entries  are  ordered  by  record  num¬ 
ber  of  the  first  occurrence  of  the  word  in  the  tape  file.  Finally,  all  occurrences  of 
each  of  the  high-frequency  words  are  read  in  from  tape,  to  form  a  new  and  much  shorter 
list  of  word  and  sentence  number  entries. 

Step  (5)  originally  located  and  printed  all  the  sentences  whose  numbers  remained  on 
the  list  after  execution  of  steps  (3)  and  (4). 

2.3.3  Evolution  of  the  Algorithm 

The  chapter  "Basic  Public  Goals,"  from  Competition  and  Monopoly,  by  Mark  S.  Massel, 
was  used  as  the  test  chapter  for  evaluation  of  the  algorithm,  hi  the  first  test,  value 
VI  in  step  (3)  was  set  at  40,  and  V2  v/as  set  at  50.  This,  with  the  original  algorithm 
for  step  (5),  produced  a  printout  of  178  sentences  out  of  479  sentences  in  the  complete 
text.  Some  of  the  sentences  were  trivial,  but  coverage  of  the  material  was  very  good. 
However,  178  sentences  were  far  too  many.  Two  remedies  were  considered:  changing 
step  (3)  to  reduce  the  size  of  the  list;  or  changing  step  (5)  so  that  of  the  sentence  num¬ 
bers  in  the  list,  only  those  sentences  with  more  than  one  high-frequency  word  would 
be  printed.  The  latter  remedy  was  chosen  because  it  produced  less  deterioration  in 
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the  coverage  than  reducing  the  size  of  the  list.  This  was  because  in  order  to  signifi¬ 
cantly  reduce  the  number  of  sentences  output  in  step  (3),  the  number  of  high-frequency 
words  retained  would  have  to  be  dropped  from  7  to  2.  Choosing  only  those  sentences 
with  more  than  one  high-frequency  word  dropped  the  number  of  sentences  from  178  to 
53.  There  was,  of  course,  some  loss  in  coverage.  For  instance,  the  significant 
sentences  dealing  with  problems  in  handling  the  economy  of  agriculture  dropped  fi:om 
5  to  only  1,  in  which  "small  farmers  and  small  business"  are  mentioned  together. 

Examination  of  these  results  showed  that  dropping  one  more  high-frequency  word 
would  affect  the  coverage  very  little.  Dropping  VI  in  step  (3)  from  40  to  10  accom¬ 
plished  this,  and  the  niunber  of  sentences  then  output  in  step  (5)  dropped  to  48  sen¬ 
tences.  This  meant  we  had  about  10%  of  the  sentences,  with  good  coverage,  and  onlj 
about  7  undesirable  sentences  in  the  output. 

Since  48  sentences  were  still  a  good  many  to  read,  and  because  an  even  higher  per¬ 
centage  might  be  selected  on  another  text,  it  was  decided  to  modify  step  (5)  again, 
with  the  idea  of  increasing  selectivity  and  decreasing  repetition.  This  time  only  those 
sentences  were  to  be  printed  which  contained  more  than  two  high-frequency  words,  or 
two  high-frequency  words  if  it  was  the  first  occurrence  of  that  pair  in  the  text.  Ou^ut 
from  this  test  was  very  encouraging.  Eighteen  sentences,  about  3. 8%  of  the  text,  were 
printed,  and  they  were  all  desirable,  with  high  information  content.  Twelve  of  the  18 
sentences  (two-thirds)  were  those  categorized  as  "indexible"  in  the  beginning  of  the 
sentence-dictionary  experiment  (subsection  1.1).  Since  only  about  45%  of  the  sen¬ 
tences  had  been  categorized  as  indexible  in  the  previous  nm,  this  represented  a  21% 
improvement  by  the  only  objective  measurement  we  have .  Figure  2  shows  the  extract 
produced.  Sentences  categorized  as  indexible  are  preceded  by  an  I;  others  are  pre¬ 
ceded  by  an  N. 

The  algorithm  will  now  be  tested  on  other  data;  further  modifications  will  then  be 
considered  if  necessary,  and  the  entire  data  base  will  be  retested. 
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Ecoaomic  aims  cover  such  features  as  economic  growth,  inflstion.  Mod  stability.. 

Each  of  (hese  public  objectives  has  a  substantial  bearing  on  policy  issues  affecting  competition. 
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2.4  MEDICAL  INFORMATION  RETRIEVAL 


During  the  past  year,  the  routine  for.preparing  a  list  of  possible  index  terms  from  the 
book  Current  Medical  Terminology  (Ref.  5)  was  completed,  adapted  for  use  with  the 
DIALOG  information  retrieval  system  (Ref.  6),  and  documented.  (See  subsection  3.6.), 
Several  interesting  tests  of  retrieving  data  from  this  system  were  completed. 

Current  Medical  Terminology  lists  diseases  with  their  attributes,  e.  g. ,  synonyms, 
etiology,  symptoms,  signs,  complications,  diagnostic  laboratory  and  x-ray  tests,  and 
pathology.  The  index  preparation  routine  extracted  the  full  phrases  entered  in  the  book, 
like  "dilation  of  the  blood  vessels,"  and  also  the  constituent  nuun  phrases,  like  "dilation" 
and  "blood  vessels,"  and  also  the  constituent  nontrivial  words  of  noun  phrases,  like 
"blood"  and  "vessels."  Att'',*ched  to  each  index  item  was  a  code  for  the  type  of  entry 
(e.g. ,  disease  name,  or  synonym,  or  sign,  or  symptom,  etc. )  and  for  the  number  of 
the  disease  with  which  it  was  associated.  Figures  2a  and  2b  of  Ref.  2  give  an  example 
of  the  index  phrase  formation.  Subsection  3. 5  of  this  report  documents  the  program. 

The  index  phrases  were  alphabetized  and  a  portion  of  the  list  (entries  of  types,  disease 
name,  sign,  and  symptom)  was  loaded  into  a  file  in  the  DIALOG  retrieval  system.* 
DIALOG  allows  the  user  to  formulate  search  requests  via  a  video-keyboard  display 
terminal.  The  user  enters  desired  commands  such  as  "begin  search,"  "display," 
"expand"  (find  alphabetically  near  terms),  "select,"  or  "combine"  by  depressing  keys 
on  the  keyboard.  The  computer  responds  by  building  sets  of  data  in  the  computer  for 
reference,  or  by  displaying  or  printing  such  sets.  Under  this  system,  a  user  expand¬ 
ing  DS  (disease)/pancreatitis  will  see  displayed  among  other  terms  DS/pancreatitis, 
interstitial  and  DS/pancreatitis,  hemorrhagic.  He  may  then  select  one  of  these  for  full 
display.  A  user  may  select  and  combine  signs  and  symptoms  to  formulate  a  request 
for  the  set  of  all  diseases  with  a  combination  of  limitations.  For  example,  he  may 
form  a  set  of  all  diseases  with  signs  or  symptoms  of  [loss  of  weight]  and  [(dryness 
or  dry)  and  skin]  and  not  [pallor] .  Because  of  the  method  of  forming  the  index. 


*Programs  for  executing  this  loading  were  prepared  by  Dexter  Schultz,  Organization 
19-43. 
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which  provides  a  very  thorough  multilevel  index,  and  because  of  the  versatility  of  the 
DIALOG  search,  an  impressive  narrowing  of  the  disease  possibilities  associated  with 
given  symptoms  is  possible. 

To  test  the  possible  quality  of  the  retrieval,  attempts  to  answer  questions  on  the  state 
medical  board  examination  were  made.  The  first  question  on  one  test  was  "Describe 
a  grand  mal  QJileptic  sign  and  differentiate  it  firom  a  major  hysterical  attack."  Ex¬ 
panding  the  possible  item  "DS/epilepsy"  gave  epilepsy,  grand  mal  as  the  seventh 
item,  which  was  selected,  displayed,  and  printed.  "DS/hysteria"  gave  hysteria, 
hysterical,  and  hysteric  personality  as  the  fifth,  sixth,  and  seventh  items.  Combining 
these  by  means  of  an  "OR"  operation  showed  them  all  to  refer  to  a  single  entry,  which 
was  selected,  displayed,  and  printed.  Since  each  disease  entry  includes  signs  and 
symptoms,  the  answer  to  the  first  question  can  be  read  directly  from  the  printout. 

Questions  regarding  physiology  or  treatment  could  not  be  handled  because  this  infor¬ 
mation  was  not  recorded  in  the  file.  The  most  difficult  type  of  question  within  the 
scope  of  the  file  was  one  on  differential  diagnosis.  "A  young  adult  male  has  anorexia, 
vomiting,  and  mild  continuing  nausea  for  3  days.  He  then  notes  dark  urine  and  light 
stools.  Discuss  clinical  and  laboratory  differential  diagnosis."  Combining  anore'iia, 
vomiting,  and  navsea,  as  either  signs  or  symptoms,  in  an  "OR"  set,  yielded  471  dif¬ 
ferent  disease  citations.  There  were  32  citations  with  an  entry  of  signs  or  symptoms 
containing  "stools"  and  two  with  urine,  one  with  "urine  dark"  and  one  with  "urine 
darkened."  Combining  all  these  (471  +  32  +  2)  in  an  "and"  set  to  give  "(anorexia  or 
vomiting  or  nausea)  and  (urine  dark  or  darkened)  and  stools"  gave  no  citation  at  all. 
Dropping  "stools"  from  the  requirements  did  not  help.  Combining  (anorexia  and 
vomiting  and  nausea)  and  (urine  dark  or  urine  darkened)  yielded  one  citation,  which 
turned  out  to  be  hepatitis,  homologus  serum.  Combining  (anorexia  and  vomiting  and 
nausea)  yielded  46  other  possibilities,  such  as  mesentery  cyst  and  cirrhosis  of  the 
liver.  From  the  printouts,  distinguishing  lab  and  clinical  tests  could  be  extracted  for 
the  answers  to  the  test  question.  It  is  likely  that  hepatitis  is  what  the  examiner  had 
in  mind  since  it  is  the  only  one  in  which  the  symptom  dark  urine  shows  up  in  com¬ 
bination  with  the  other  symptoms.  Unfortunately,  though  the  symptoms  of  infectious 
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and  serum  hepatitis  are  identical ,  the  data  source  Current  Medical  Terminology  failed 
to  list  the  symptom  darkened  urine  under  infectious  hepatitis  while  it  diJ  list  it  under 
serum  hepatitis.  This  points  up  the  dual  nature  of  an  adequate  evaluation  of  the  use¬ 
fulness  of  such  a  retrieval  system.  First,  is  the  data  source  adequate  or  can  it  be 
made  to  be  adequate?  Second,  given  a  good  data  base,  are  the  index  formation,  file 
generation,  and  retrieval  tools  adequate? 
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Section  3 

DOCUMENTATION 


3.1  BPHRAS  PROGRAM 

BPHRAS  was  documented  in  last  year's  report  (Ref.  2),  where  there  are  sections  on. 
description,  input  and  ou^ut  format,  theory,  tables,  and  a  flow  diagram.  However, 
since  changes  have  been  made  in  the  logic,  the  corrected  flow  diagram  will  be  included 
here,  and  it  will  also  include  the  additions  made  for  extracting  purposes.  These  addi¬ 
tions  involve  the  output  of  possible  index  words  (subsection  2.3)  which  come  out  on 
disk  because  both  tape  units  are  in  use.  Output  is  performed  by  a  logical  IOCS  module 
called  LLEIWRD  which  in  turn  uses  IOCS  module  UGFOZZZ.  Records  of  25  bytes 
each  are  put  out  on  disk  in  a  block  of  1633  bytes.  The  first  22  bytes  of  each  record 
are  the  EBCDIC  representation  of  a  word;  the  last  3  bytes  contain  the  page  and  sen¬ 
tence  number,  2  bytes  for  the  page  number  in  binary,  right  justified ,  and  1  byte  for  the 
sentence  number.  This  is  the  same  information  as  is  contained  in  fields  2  and  3  of 
the  phrase  structure  output  of  BPHRAS. 

After  BPHRAS  is  run,  the  possible  index  words  must  be  processed  further.  They  are 
taken  from  the  disk,  sorted  into  alphabetic  order,  and  stored  on  magnetic  tape.  (See 
subsection  3.4  for  the  SORT  control  cards.) 

The  new  BPHRAS  flow  diagram  is  shown  in  Fig.  3. 

3.2  PHRASE -STRUCTURE  SORT 

After  the  BPHRAS  program  has  processed  a  text  to  produce  a  tape  with  the  phrase 
structure  of  each  sentence  (Ref.  2,  subsection  5.3),  we  may  wish  to  examine  the 
similarity  of  structures  within  that  text.  To  do  so,  a  program  is  needed  to  sort  the 
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Fig.  3  BPHRAS  Flow  Diagram 
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Fig.  3  BPHRAS  Flow  Diagram  (Cont. ) 
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Fig.  3  BPHRA.S  Flow  Diagram  (Cont. ) 
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BPHRAS  Flow  Diagram  (Cont. ) 
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Fig.  3  BPHRAS  Flow  Diagram  (Cont. ) 
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Fig.  3  BPHRAS  Flow  Diagram  (Cont. ) 


records  (each  record  corresponds  to  one  sentence)  according  to  their  phrase  struc¬ 
tures.  The  records  and  their  fields  are  variable  in  length,  but  the  structure  field, 
which  is  also  the  field  of  the  SORT,  always  begins  in  the  same  place.  The  length  of 
the  SORT  was  successfully  set  at  100  b3rtes,  an  adequate  length  for  longer  records. 

The  feet  that  this  makes  the  SORT  field  extend  beyond  the  record  for  shorter  sentences 
does  not  seem  to  have  caused  any  problem  in  SORT,  although  it  affects  the  results  as 
noted  in  subsection  2. 2.  The  control  cards  for  one  file  are  as  follows: 

//  JOB  SORT  BPHRAS  PHRASE  OUTPUT 
//  ASSGN  SYSOll,  X’191' 

//  ASSGN  SYS002,  X'181' 

//  ASSGN  SYSOOl,  X'180» 

//  VOL  SYSOll,  FILEW 
//  BLAB  'SORT  WORK  AREA  1094737',  C 
001,  68000,  68100';  DA 

//  XTENT  1,  0,  000010000,  00198008,  '094737',  SYSOll,  O 
//  EXEC  DSORT 

RECORD  TYPE  =  V,  LENGTH  =  (1500,  1500,  20,  1000) 

SORT  HELDS  ==  (10,  100,  A),  FORMAT  =  BI,  HLES  =  1,  SIZE  =  500 
INPFIL  INPUT  =  T,  BLKSIZE  =  (2000) 

OUTFIL  OUTPUT  =  T,  BLKSIZE  =  (2004) 

OPTION  PRINT,  LABEL  =  (U,  U) 

END 

To  sort  n  more  files,  assign  SYS003  through  SYSOO  (3  +  n  -  1)  to  X'181'.  Change  the 
FILES  entry  in  the  SORT  card  and  add  OPEN  =  NORWD  and  CLOSE  =  NORWD  to  the 
INPHL  card. 

3.3  EXTRACT  PROGRAM 

Fiuiction:  The  EXTRACT  program  carries  out  task  3  listed  in  subsection  2. 3;  that  is, 
it  calculates  the  frequency  count  of  the  possible  index  words  output  by  the  BPHRAS 
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program  (subsection  3.1)  and  ordered  by  an  EXTRACT -SORT  program  (subsection  3.4). 
It  then  calculates  a  cutoff  point  based  on  these  counts  and  discards  all  words  with  a 
frequency  count  below  this  point.  The  remaining  words  are  output  with  their  page  and 
sentence  numbers.  The  flow  diagram  is  show  in  Fig.  4. 

Input  Format;  Alphabetized  words  on  magnetic  tape,  one  word  per  logical  record, 
packed  into  a  1625-byte  physical  record.  Each  logical  record  is  25  bytes,  22  bytes 
for  the  word  (padded  with  blanks)  and  3  bytes  for  the  page  (first  2  bytes)  and  sentence 
number  (last  byte).  Page  and  sentence  numbers  are  in  binary,  right  jxistified. 

Output  Format:  Exactly  the  same  as  the  input  format,  although  the  file  is  shorter. 

Logical  IOCS  Modules:  LLEEXTI  and  LLEXTO,  the  former  reading  from  SYS008,  the 
latter  writing  onto  SYS009. 


Buffers  and  Tables; 


CURRENT 

HOLD 

COUNT 


DIFF 


PERCENT 


25-byte  current  LLEEXTI  record  buffer 
25-byte  hold  record  buffer 

Table  with  4-byte  entries,  2  bytes  for  frequency  count  followed  by 
2  bytes  for  the  number  of  the  record  with  the  first  occurrence  of 
that  word 

Table  with  two-word  (S-byrte)  entries,  one  word  for  the  difference 
in  adjacent,  ordered  frequencies  and  one  word  for  the  address  in 
the  COUNT  table  of  the  higher  frequency 
Table  with  three -word  entries,  one  word  for  the  percent  of  this 
frequency  of  the  siun  of  ail  frequencies ,  one  word  for  the  cumu¬ 
lative  percent,  and  one  word  for  the  address  of  the  frequency  in  the 
COUNT  table. 
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Fig.  4  Flow  Diagram  for  EXTRACT  Program 
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3.4  EXTRACT  SORTS 


There  are  three  sorting  programs  necessary  for  the  extracting  experiment,  for 
steps  (2),  (4),  and  (5)  given  in  subsection  2. 3.  Control  cards  for  each  SORT  program 
are  given  below. 


//  JOR  StlRT  ITFMS  FROM  LUSK 
//  ASSGN  SYS005,X'192' 

//  ASSGN  SYSOOltX' 180‘ 

//  ASSGN  SYS004,X' 191* 

//  VOL  SYsooitFiuen 

//  TPLAR  'INDEX  WORD  FILE  XXXXXXXXXXXXXXXXXXXX  6b36S  XXXXXX  DUS36C 

0  ISLMSC 

//  VOL  SYS004,FILeA 

II  DLAR  'INi'FX  WORD  FILE  1094737',  C 

0001,68100,68100,'  ',S0 

//  XTENT  1,0,000002000,000197009, '094737' ,SYS004,0 
//  VOL  SYS005,FILEW 

//  DLAB  'SORT  WORK  AREA  1SSYS02',  C 

0001,68100,68100,'  ' ,DA 

//  XTENT  1,0,000075000,000198000, 'SSYS02' ,SYSn0!>,0 
II  EXEC  DSORT 

SORT  FIEL0S=( 1,?2,A) ,FaRMAT=BI ,F I LES= 1 ,S I ZE=3000 
RECORD  TYPE=F,LFMGTH=<25) 

INPFIL  lNPUT=n,BLKSIZE=(l625,X) 

OUTFIL  3LKSIZE=1625,nUTPUT=T 
OPTION  PRINT, LABEL=iU,S) 

END 


Step  (2)  to  sort  the  index  words  into  alphabetical  order  and  move  the  file  from  disk  to 
tape. 
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//  JOB  SORT  OUTPUT  EXTRCT  INTO  SENTENCE  ORDER 
//  ASSGN  SYSOOStX* 191  • 

//  ASSGN  SYS001,X'lal' 

//  ASSGN  SYS002,X' 181  • 

//  VOL  SYSOOSfFILEW 
//  DLA8  ‘SORT  WORK  AREA 

0001,68100,68100,*  i ,DA 

//  XTENT  1»0, 000160000, 000198008, *094737' ,SYS005,0 
//  EXEC  DSORT 

SORT  FIELDS=(23,3,A) ,F0RMAT=8I ,FILES=1,S12E=800 
RECORD  TYPE=F, lengths (25) 

INPFIL  INPUT=T,BLKSIZE=(1625,X) 

OUTFIL  0UTPUT=T,8LKSIZ6=1625 
OPTION  PRINT, LABEL=(U,U) 

END 


Step  (4)  to  sort  a  tape  file  of  index  word  —  page  and  sentence  number  -  records  into 
order  by  page  and  sentence  numbers.  (Tape  file  as  ou^ut  by  the  EXTRACT  program. ) 


//  JOB  SORT  SENDIC  OUTPUT  BACK  TO  PAGE-SENTENCE  OR 
//  ASSGN  SYS005,X*191'  ? 

//  ASSGN  SYS005,X»192'/  ^ 

//  ASSGN  SYS002,X'180*) 

//  ASSGN  SYS002,X' 181  *5  /  f 

//  ASSGN  SYS001,X'180'j 
//  VOL  SYS005,FILEW  ' 

1 1  DLAb  'SORT  WORK  ARFA 

0001,68100,68100,'  ',DA 

//  XTENT  1,0, 000160000, 000198008, *094737*, SYS005,0 
//  EXFC  DSORT 

SORT  FIEL0S=(6,3,A) ,F0RMAT=BI ,FILES=1,SIZE=750 
RECORD  TYPE=V,LFNGTH=( 1500, ,1500,20,1000) 

INPFIL  INPUT=T,BLKSIZE=(2000) ,OP£N=NURWD 
OUTFIL  nUTPUT=T,BLKSIZr=(2004) 

OPTION  PRINT, LABEL=(U,U) 


1094737' , 


Step  (5)  to  sort  a  tape  file  of  sentences  (as  output  by  the  SENDIC  program)  into  order 
according  to  the  page  and  sentence  numbers. 

3.5  PENTEXTr  PROGRAM 

Function:  The  I  "’.NTEXT  program  carries  out  task  (5)  listed  in  subsection  2.3;  that 
is,  it  does  the  actual  forming  and  printing  of  an  extract.  It  uses  two  sources  of  data : 
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(1)  a  set  of  high-frequency  words  produced  by  EXTRACT  and  then  ordered  by  sen¬ 
tence  number  and  (2)  the  SENDIC  output  of  the  processing  of  the  original  text,  in 
sentence  number  order.  At  the  present  time,  PRNTEXT  is  set  \jp  to  extract  from  the 
first  data  source  all  sentence  numbers  which  have  either  three  or  more  high-frequency 
words  or  two  high-frequency  words  if  it  is  the  first  occurrence  of  that  pair  together  in 
one  sentence.  (In  keeping  track  of  pairs  in  a  sentence,  every  word  after  the  second 
word  is  paired  only  with  the  first  and  second  words;  therefore,  for  sentences  with 
four  or  more  words,  not  all  possible  pairs  of  words  are  linked. )  It  then  looks  up 
these  sentence  numbers  in  the  second  data  source  and  prints  the  sentences.  The  flow 
diagram  is  in  Fig.  5. 

Input  Format:  See  output  format  of  EXTRACT. 

Output  Format:  Output  is  on  the  printer.  Each  sentence  is  prefaced  by  a  line  in  which 
an  N  or  I  is  printed,  for  nonindexible  or  indexible,  and  a  number  giving  the  page  and 
sentence  number  of  the  sentence.  A  constant  was  added  to  the  page  number  to  indicate 
the  text.  An  error  in  the  assignment  of  these  constants  has  made  the  page  and  sen¬ 
tence  number  meaningless  for  some  texts. 

Logical  IOCS  Data  Modules ;  SENTFL  is  used  to  read  the  sentence  tape  from  SYS002. 

It  reads  variable  size  records,  blocked  2000,  and  goes  to  EOFROUT  on  end  of  file. 
LLEEXTI  is  used  to  read  the  word-sentence  niamber  items  from  tape  SYSOOS.  It 
reads  25-byte  records  blocked  1625  and  goes  to  EOF  on  end  of  file.  PRINT  is  used 
to  print  the  sentences  on  the  printer  from  buffers  whose  address  is  passed  to  PRINT 
in  register  3. 

3.6  MEDLIST  PROGRAM 

The  MEDLIST  program  documentation  has  been  organized  as  follows:. 

•  User's  Documentation 

A.  Purpose 

B.  Input  Description 

C.  Program  Description  -  General 
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Fig.  5  Flow  Diagram  for  PRNTEXT  Program 
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to© 


Fig.  5  Flow  Diagram  for  PRNTEXT  Program  (Cont, ) 
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D.  Program  Operation 

E.  Output  Description 

F.  Core  Storage 

G.  Timing 

H.  Language 

I.  Control  Cards  and  Seti?) 

J.  Error  Dumps 
•  Internal  Documentation 

A.  Overall  Program  Operation  (with  concept  flow  diagram) 

B.  Program  Modules 

1.  LLEMREAD  Subroutine 

2.  MEDLIST,  main  program 

a.  Macros  used 

b.  Detailed  flow  diagram 

c.  Internal  subroutine  MPOSB,  description  and  flow  diagram 

d.  Internal  subroutine  CHKEND,  description  and  flow  diagram 

e.  Internal  subroutine  FILLBUFF,  description  and  flow 
diagram 

3.  IOCS  file  definition  parameters 
3.6.1  User's  Documentation 

A.  Purpose:  This  program  is  designed  to  process  the  information  of  the  AMA  listing 
of  diseases  with  their  etiology,  signs,  symptoms,  etc. ,  so  that  the  information  can  be 
more  easily  used  in  a  retrieval  system.  In  its  present  form  it  prepares  a  magnetic 
tape  of  medical  phrases,  recorded  in  a  format  acceptable  for  input  to  the  program  in 
the  NASA  retrieval  system  which  prepares  the  inverted  file. 

B.  Input  Description;  The  AMA  tape  consists  of  80-chai-acter  records.  Each  record 
begins  with  an  8-digit  number  (col.  1-8);-  the  first  four  digits  give  the  disease  number, 
the  fifth  digit  gives  the  category  of  information  on  the  card,  the  sixth  digit  gives  the 
number  of  the  sentence  within  the  category,  and  the  seventh  and  eighth  digits  give  the 
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number  of  the  card  within  the  sentence.  (Except  in  category  0,  sentences  are  termi¬ 
nated  by  a  period. )  The  categories  are  as  follows; 


Category  No. 

Letter  Code 

Meaning 

0 

DS 

disease 

1 

AT 

alternate  term 

2 

ET 

etiology 

Q 

o 

SM 

symptoms 

4 

SG 

signs 

5 

CM 

complications 

6 

L3 

laboratory  tests 

7 

XR 

x-ray  tests 

8 

PA 

pathology 

9 

RF 

references 

(Letter  codes  are  given  here  because  they  are  used  in  the  output. )  On  most  cards 
(category  2-9),  coliunns  9-20  are  blank  and  information  is  punched  in  columns  21-80 
or  a  portion  thereof,  starting  always  in  column  21.  Category  9  has  a  code  in  column  9, 
usually  an  A.  Categories  0  and  1  may  or  may  not  have  a  letter  code  in  column  9,  e.g. , 
C  for  "see  also,"  and  may  or  may  not  have  the  numbers  of  the  disease  in  other  refer¬ 
ence  systems  in  columns  10-19  or  76-80.  These  numbers  may  or  may  not  fill  their 
field  and  may  or  may  not  contain  special  characters  (letters,  hyphen,  period).  In 
these  categories,  columns  21-75  can  be  blank..  In  categoi^^  0,  there  is  no  period 
terminating  the  disease  name,  but  in  category  1  there  is. 

C.  Program  Description  -  General;  The  MEDLIST  program  reads  the  AMA  input  tape 
descrioed,  processes  it,  selecting  and  outputting  possible  index  items,  each  as  a 
separate  logical  record.  It  reads  and  processes  one  sentence  at  a  time.  Each  sen¬ 
tence  is  first  broken  down  into  constituent  phrases  marked  in  the  input  by  #  ,  n  ,  or 
other  one-character  delimiter,  not  alphabetic,  and  not  a  comma  or  period.  Each 
phrase  is  ou^ut  as  a  possible  index  item,  identified  by  its  disease  number  and  cate¬ 
gory  code.  Each  of  the  phrases  is  then  examined  and  each  noun  phrase  within  the 
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larger  phrase  is  isolated,  identified  by  the  disease  number  and  category  code  and 
output  as  a  separate  record.  Each  noun  phrase  is  then  broken  down  into  its  constituent 
words  which  are  not  adverbs,  articles,  adjectives,  or  participles,  and  each  word  is 
output  as  a  separate  record,  again  identified  by  disease  number  and  category  code. 

The  index  items  are  all  prefixed  by  the  category  code  and  suffixed  by  the  disease 
numbers,  as  described  in  output  format  below.  See  the  internal  documentation  for 
details  of  sentence  reading,  phrase  and  noun  phrase  delimitation,  elimination  of 
extraneous  numbers  or  of  dtplicate  items,  etc. 

D.  Program  Operation:  The  equipment  needed  for  operation  includes  the  card  reader, 
typewriter,  printer,  tape  units  180  and  181,  and  disk  190  with  the  DOS  system  disk 
mounted.  Tape  unit  181  is  used  for  output  and  tape  unit  180  for  two  kinds  of  input. 

Part-of-speech  information  is  needed  to  identify  noun  phrases.  The  algorithm  which 
assigns  part-of-speech  codes  uses  a  dictionary  for  the  parts  of  speech  of  special  words, 
and  this  dictionary  is  read  in  from  tape  on  unit  180.  The  density  code  for  this  tape  is 
90,  or  93  in  core,  and  the  density  code  for  the  AMA  input,  which  is  also  read  from 
180,  is  68  or  6B  in  core.  Since  under  DOS  the  density  of  a  given  unit  is  not  changeable 
by  program  or  control  cards,  it  must  be  changed  by  keying  in  the  correct  ^  alue  after 
the  dictionary  tape  rewinds,  while  the  computer  waits  for  tapes  to  be  changed.  To  do 
this  push  stop,  key  '6B'  into  location  16  AB,  remove  the  dictionary  and  moimt  the  AMA 
input  tape  on  unit  180,  and  push  start. 

To  run  the  program,  therefore: 

1.  Mount  PA  58  on  180  and  a  scratch  taje  on  181. 

2.  Load  the  program  from  the  card  reader. 

3.  When  PA  58  rewinds,  remove  and  mount  the  AMA  tape  on  180. 

4.  Push  step,  then  key  6B  into  location  16AB. 

5.  Push  start.  Program  will  run  until  EOF  is  encountered  on  the  input  tape. 

The  output  tape  will  rewind  and  unload.  Core  will  be  dumped  and  control 
will  return  to  the  DOS  system. 
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Normally,  the  AMA  tape  will  be  processed  starting  with  the  first  record.  To  start  at 
a  given  accession  number,  use  a  REP  card  to  store  the  eight -digit  number  at  START 
in  MEDLIST,  and  store  the  hex  digits  4700  at  ML30  in  MEDLIST. 

E.  Output  Format:  As  noted  under  program  description,  each  index  item  is  output  as 
a  separate  logi.  ,1  record.  The  logical  records,  to  meet  the  NASA  retrieval  system 
restraints,  are  54  bytes  long,  with  a  blocksize  of  1728  bytes.  Items  are  truncated 

or  filled  with  blanks  to  conform  to  the  54-byte  length.  The  first  3  bytes  of  each 
record  are  the  category  letter  code  (see  input  description)  followed  by  a  slash,  and 
the  next  47  bytes  (4-50)  are  the  index  item.  The  last  4  bytes  (51-54)  of  each  record 
contain  the  packed  digits  810XXXX  where  XXXX  is  the  disease  number.  This  gives  a 
hexadecimal  '810XXXXF'. 

F.  Core  Storage:  Total  storage  used  by  MEDLIST  program ,  dictionary.  IOCS,  and 
dump  programs,  about  28000  bytes.  See  the  linkage  editor  output. 

G.  Timing:  It  takes  1  hour  to  process  one  full  tape  after  the  dictionary  is  read. 

Allow  an  additional  5-10  minutes  for  dictionary  reading  and  changing  of  tapes  and 
density. 

H.  Language:  Assembly  language  with  some  self-written  macros;  logical  IOCS  used 
for  I/O.  See  section  B2a  and  B3  in  subsection  3.6, 2. 

I.  Control  Cards  and  Setup: 

//  JOB  MEDLIST 

//  ASSGN  SYS005,  X'180' 

//  ASSGN  SYS002,  X'180' 

//  ASSGN  SYS003,  X'181' 

//  OPTION  LINK 

PHASE  MEDLIST,  ROOT 
INCLUDE 
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MEDLIST  object  deck 

LLEMREAD  object  deck  (or  catalog  it) 

//  EXEC  LNKEDT 
//  EXEC 

Autolink  will  bring  in  $DUMP,  $PRINT,  LLEDICT,  LLEMEDO,  LLETPCI,  IJFFZZZZ, 

IJFFZZWZ  from  the  DOS  disk.  See  the  section  Program  Operation  for  operating 

instructions,  page  3-24. 

J.  Error  Dumps: 

1.  An  unlabeled  dump  of  the  CBUFFl  area  in  LLETPCI  (see  linkage  editor  output  for 
address)  will  result  if  there  is  a  tape  errcr  in  reading  the  input  tape.  The  error 
will  be  ignored  and  the  program  will  continue.  Such  a  dump,  followed  by  an  im- 
labeled  dump  of  the  SENTBUFF  area,  will  also  result  if  a  sentence  is  so  long  that 
the  SENTMAP  buffer  is  exceeded.  The  rest  of  that  sentence  will  not  be  processed, 
but  the  program  will  continue. 

2.  A  dump  of  the  SENTBUFF  area  labeled  TRUNCATE  will  result  if  the  BUFF  area 
for  output  is  filled.  The  rest  of  the  sentence  will  not  be  processed,  but  the  pro¬ 
gram  will  continue. 

3.  A  dump  of  the  SENTBUFF  area  labeled  SENTBUFF  wiU  result  if  a  sentence  begins 
with  a  word  of  less  than  eight  letters.  (Each  sentence  begins  a  new  card. )  The 
entire  sentence  is  skipped,  and  the  program  contini;es.  If  a  sentence  begins  with 
a  word  of  more  than  eight  letters,  a  blank  is  stored  in  the  nin<^h  column  to  force 
an  eight -letter  word,  because  occasionally  the  eight-letter  number  was  run  i:'to 
the  following  disease  code. 

3.6.2  Internal  Docuro entation 

A,  Overall  Program  Operation:  The  main  progi am ,  MEDLIST,  uses  fhe  subroutine 

LLEDICT  to  read  entries  from  the  dictionary  tape,  LLEMREAD  to  read  a  sentence  at 
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a  time  from  the  input  tape,  and  LLEMEDO  to  write  index  entries  on  the  output  tape. 
LLEDICT  and  LLEMEDO  are  file  definition  logical  IOCS  modules,  using  modules 
IJFFZZZZ  and  UFFZZWZ,  respectively,  LLEMREAD  is  a  subroutine  which  reads 
as  many  cards  as  necessar^^  to  bring  in  a  complete  sentence,  which  it  delivers  to 
MEDLIST  along  with  a  map  giving  the  location  and  the  length  of  each  word  or  mark  of 
punctuation  and  the  number  of  words  in  the  sentence.  LLEMREAD  calls  the  file  defi¬ 
nition  module  LLETPCI  to  read  card  images  from  the  tape.  LLETPCI  uses  module 
IJFFZZZZ  (as  does  LLEDICT).  Overall  MEDLIST  operation  can  be  depicted  in 
Fig.  6. 


Program  Modules; 


1.  LLEMREAD  Subroutine 


Calling  sequence: 

L  13,  =  V(MREAD) 
BALR  14,  13 
DC  Y(SENTBUFF) 
DC  Y(SENTMAP) 

DC  Y(NWORDS) 

DC  Y(EOF) 


SENTBTIFF  is  the  starting  address  of  the  buffer  in  which  the  sentence  is  to  be  stored. 
Currently  it  is  a  1000-byte  buffer  in  MEDLIST.  '  "NTMAP  is  the  starting  address  of 
the  buffer  where  the  location  and  length  of  each  word  is  to  be  stored  in  the  order  in 
which  the  words  appear  in  the  sentence.  One  full  computer  word  is  used  for  each 
English  word,  the  first  half  for  location,  the  second  half  for  length.  There  is  cur¬ 
rently  an  800-byte  SENTMAP  buffer  in  MEDLIST,  providing  space  for  200  words. 
NWORDS  is  the  address  of  the  half  word  where  the  number  of  English  words  is  to  be 
stored.  EOF  is  the  address  where  control  is  to  be  transferred  when  the  EOF  is 
encountered  on  the  input  tape.  The  LLEMREAD  subroutine  is  shown  in  Fig.  7. 
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Wm  Uw  tnd  q( 
phr«M  t  ptriad? 

I  ,  I  All  HAP  prvc* 

[  Oo  to  r«^  aiioOMr  I 


Ho  Within  thi*  phrtM  li  th«r«  anoUwr  I 
••parata  noun  phraaa  unprocanaad?! 
I  Yea 

Put  out  the  noun  phraaa  with  a 
LLEMEDO  rail,  axcapt  laava 
acceaali^n  fa  wtlhln  phraaa 


la  thara  more  than  ona  word  in  noun  I 
phraaa  (or  phraaa  If  HAP  >  phraaap  I 


Put  out  each  word  in  noun  phraaa 
with  a  LLEMEDO  call .  aacapt 
parttrlpica  adjactlvaa  adverba 
and  arreaaion  numhara 


I  Have  all  NAP  in  NAPT  been  procaaaed? 


Fig.  6  Overall  MEDLIST  Operation 
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,  U  col  7A  so  MSI* 


Store  col  «•  word  with  the  follow  i 
InK  hUidi  Step  RS  R?  I 


I  Move  a  period  Into  Sf  KTRt'f  >  ntnrr  I 
I  location  and  leratth  Step  R6  R7  | 


I  Add  TO  to  ni  I  to  cet  the  laat  eddreoal 
of  (hr  card  Imaae  and  etore  In  RI4  ) 


(  (ear  ro^a  9  and  70  hO  of  the  Input 
cold  and  more  a  |wrind  In  col  7a 
(Thii  will  allow  (tie  'Itoeaar  tHi»w  tv  lx 
treated  aa  a  aeparate  aenlenre  later  I, 


I  lo  RMh  to  ealt  TO»mnr  j 


More  Hit  a<htrrae  <>l  ih<  ii^hjI  lard 
imJKr  in  I  I  ‘tet  RI4  to  t  I  piua  7*< 
and  Blore  m  f  NIX'I 


IxmH  III  I  lr-*m  >  I  jnd  III  t  lr»n>  I  NIX  |  | 


I^M  «  M  1 1  i-oinl  I  I  III  mi 


Fig.  7  LLEMREAD  Subroutine 
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I  Steo  Rl  I  lo  next  blxnk  or  col  SO  I 


I  Reduce  Ril  by  1 


Doe*  Rll  polid  to  •  non-tlpb*  character? 


I  Reetore  R1 1  to  point  to  blank  of  col  B1 


I  Set  Rtl  -  Ril  • 
I  word  and  blank 


_i - - 

>  RIO.  I  e  .  lenfth  *1  of  | 


m 


Move  word  actd  blaidt  into  SENTBUFF  and 
•tore  location  and  length  into  8ENTMAP 


Step  RO  and  R7 


Set  Rlt  to  next  column  >2.  1  e  . 
laat  character  word. 


'  Done  RT  exceed  R».  the  laat  SEHTMAP  addrea* 


I  Doee  RLl  point  to  a  non-alpha  character?  I 


Add  2  to  Rll  to  eet  beyond  blank  to  | 
potential  beftnnlng  of  next  word  I 


^AlV^  !•  Rll  )•••  than  R14’ 


la  ft  a  period  or  queetlon  mark 
or  exclemetlon? 


Add  3  to  Rll  to  eet  bevond  blank  to 
potential  beftnning  of  next  word 


I  Check  If  pertod  etc .  precede*  col  20  rSO  j 
I  If  *0  It  I*  not  termini  I  ^  V  J 


Compute  the  number  of  word*  |  (R7-aeotence 
map  begin)  '4|  >nd  *tore  NWORDS 


Store  Bit  in  Cl  and  RI4  in  ENDCI 
Rcatore  reglatcra  and  return 


0le  HIO  ItJi  le  lalhepuixtuauon  vesA  ^ 

the  entire  woro  in  which  «ane  It  ran 
be  treale<l  aa  anv  worff*  | 


Mo^e  th«’  imm  til  ilton  into  P 
to  x<*(  |t  oft  tb«  '  •«!  ol  word 


Fig.  7  LLEMREAD  Subroutine  (Cont. ) 
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MEDLIST,  Main  Prograni  Module 


(a)  Macros  used: 

(1)  A.  J.  Nichols  macro,  $DUMP;- see  writeup 

(2)  Logical  IOCS  macros  OPEN,  CLOSE,  GET,  PUT;'  see  IBM  S360-30 
C54-5037 

(3)  Personally  written  macros  as  follows:. 

•  TSTPS  *TYPE,  *REG,  *YES,  *NO,  *LIST.  The  TSTPS  macro  tests  the  address 
given  in  register  *REG  for  indicators  of  parts  of  speech  given  in  *LIST.  *REG 
must  contain  an  address  within  the  POS  table.  If  the  *TYPE  is  ANY,  presence  of 
any  part  of  speech  given  in  *LIST  causes  a  transfer  to  *YES.  If  *TYPE  is  ALL, 
transfer  will  be  to  *YES  only  if  all  the  parts  of  speech  given  in  *LIST  are  present. 
If  control  is  not  transferred  to  *YES,  it  will  go  to  *NO.  If  either  *YES  or  *NO  is 
omitted,  that  address  is  assumed  to  be  the  next  address  in  sequence.  The  POS 
table  has  3  bytes  for  each  word  and  1  bit  for  each  part  of  speech.  See  subsec¬ 
tion  1.3.1  of  Ref.  1. 

•  TSTFU  *REG,  *YES,  *NO,  *LIST.  TSTFU  tests  the  entry  in  the  table  FUNCTION 
for  the  word  whose  index  is  given  in  the  register  *REG.  (The  first  word  has 
index  =  0,  the  nth  word,  n-1.)  Transfer  to  *YES  occurs  if  all  the  functions  desig¬ 
nated  in  *LIST  are  present,  otherwise  transfer  is  to  *NO.  If  either  *YES  or  *NO 
is  omitted,  that  address  is  assumed  to  be  the  next  in  sequence.  For  a  description 
of  the  FUNCTION  table,  see  subsection  5.3  of  Ref.  2. 

•  SETFU  *EREGA,  *EREGB,  *EFUNC.  SETFU  records  the  function  *EFUNC  into 
the  FUNCTION  table  for  the  word  whose  index  is  in  register  *EREGA.  Register 
♦EREGB  contains  the  address  of  the  phrase  (in  the  NAPT  table)  and  *EFUNC  gives 
the  type  of  phrase,  either  TNAP  (noun  phrase),  TVBP  (verb  phrase),  or  NFP 
(infinitive  phrase).  For  a  description  of  the  FUNCTION  table,  see  subsection  5.3 
of  Ref.  2.  Caution:  SETFU  uses  register  15. 
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•  $AFIX*AFFIX,  *LENGTH,  *POS.  $AFIX  is  used  to  put  an  entry  in  an  affix 
table  for  a  dictionary  lookup.  *AFFIX  is  the  affix  (e.g. ,  TION),  ^LENGTH  is 
the  number  of  letters  (e.  g. ,  4),  and  *POS  is  an  indicator  of  the  part  or  parts  of 
speech  to  be  binarj'  coded  into  the  table  immediately  following  the  affix  (e.g. ,  N 
for  noun).  See  also  page  1-  16  of  Ref.  1. 

(b)  Detailed  Flow  Diagram 

A  detailed  flow  diagram  is  shown  in  Fig.  8. 
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to  (MUlJ 

- i - , 

SIr(,  K7  .  RS  iikl  ^  {  S«t  R*  to  Rr  AJAR  to  0 

R7  *  NWORDS  re»  '  I  S»t  ni2  and  Rll  to  C 


fH>^B  tflU  woH  have  p«rt  of 
speech  of  C  J .  PR  or  PU  ’ 


Pack  contents  of  NUMBER  Into 
BUFF  ♦  50  BUFF  ^  S3 


Write  out  BUFF  -  >  DUFF  ‘  S3  and 
clear  the  BUFF  area.  Thia  prints 
the  entire  larK^'  phrase 


Compare  R7  with  Index  of  last 
Mord  of  cut  roU  no...  pi.r^sc  (RS) 

Is  w-  higher 


to 

- - 


I  Store  n?  In  SAVFWF 
and  reduce  bv  i 


Is  current  word  Index  t ltd)  -  I  (RT)"* 


e  *  of  words  in  noun  phrase  I 
113  and  RKllS  | 


Compare  n.  fbeginning  of  noun 
phrase)  witn  current  word  index . 
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Fig.  B  MEDLIST  Detailed  Flow  Diagram  (Cont. ) 


A^TO  Rf  .-SEARCH  LABORATORY 


(c)  Subroutine  MPOSB 


The  MPOSB  subroutine  is  an  adaptation  of  the  POS  (Part-of-S|peech)  prograna  developed 
under  the  ONR  contract.  See  subsection  1.4  of  Ref.  4  and  subsection  1.3  of  Ref.  1. 
MPOSB  assigns  a  part-of-speech  code  to  a  given  word  on  the  basis  of  its  structure. 

It  assumes  that  the  address  and  length  cf  the  word  are  at  the  location  given  in  RIO, 

2  bytes  each.  It  stores  the  3-byte  part-of-speech  code  in  the  address  specified  by 
Rll.  The  calling  sequence  isBAL  14,  MPOSB  with  RIO  and  Rll  suitably  set.  Return 
is  to  the  following  location.  The  flow  diagram  is  shown  in  Fig.  9. 

(d)  Subroutine  CHKEND 

The  CHKEND  subroutine  compares  the  letters  ending  at  the  RIO  data  address  with 
entries  in  a  table  whose  address  is  in  R5.  The  entries  in  this  table  are  defined  by  the 
$AFIX  macro,  which  constructs  an  entry  composed  of  the  length  of  the  entry,  the  affix 
itself,  and  the  associated  3-byte  part-of-speech  code.  If  a  match  occurs,  R6  will  be 
set  to  the  beginning  address  of  the  matching  entry  and  return  will  be  to  the  next  in- 
sti’uction.  Otherwise  return  will  be  to  the  second  instruction  following  the  BAL.  The 
flow  diagram  is  shown  in  Fig.  10. 

(e)  Subroutine  FILLBUFF 

The  subroutine  FILLBUFF  transfers  as  many  words  as  indicated  by  R12  to  the  address 
in  Rll,  starting  with  the  word  whose  index  is  in  RIO,  deleting  8-  and  9~digit  numbers. 
If  the  last  storage  address  is  not  as  high  as  BUFF  +  49,  the  difference  is  padded  with 
blanks  and  the  contents  of  NUMBER  is  packed  into  BUFF  +  50  -*  BUFF  +  53.  The 
buffer  is  printed  and  cleared.  The  flow  diagram  is  shown  in  Fig.  11. 

^  •  IOCS  File  Definition  Parameters 

LLEDICT  ”  tape  input  file  on  SYS005,  with  80-character  records.  Goes  to  EOFD  on 
end  of  file  and  ERRJ  >n  reading  error.  No  label.  Rewinds  and  unloads.; 
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I  ;•  h$  than  tbe  laM  •ddrau  |no 
I  of  the  dictionary? 


Yf  J  Chock  RT  lettara  of  iho  word  agalnat 
•—  1  the  R5  addroai  In  ^  dictionary 
I  Tk)  they  match? 


Halve  the 
Increment 
in  R6 


iNo  to(POe33) 

,11  word  higher  y 

’Ja - 1  Ihr  incwment  I.  K6.  feaf'y 


Fig’.,  9  Gubroutine  MPOSB  Flow  Diagram 
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Fig.  11  Subroutine  FILLBUFF  Flow  Diagram 
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LLEMEDO  -  tape  output  file  on  SYS003,  with  54-character  records  blocked  1728.  No 
label.  Rewinds  and  unloads. 

LLETPCI  -  tape  input  file  on  SYS002,  with  80-character  records.  Goes  to  EOF  on 
end  of  file  and  ERR  on  reading  error.  No  label.  Does  not  rewind. 

3. 7  FREQUENCY-SYNTAX  EXTRACTING  PROCEDURE 

1.  Run  BP  HRAS  to  get  index  words  on  disk 

SYS2  -  180  -  SENTFL  input  (from  SENDIC) 

SYS3  -  181  -  phrase  output 

SYS4  -  191  or  192  -  index  word  output 

2.  Sort  index  words  from  disk  onto  tape 

SYS4  -  191  or  192  -  index  word  input 
SYSl  -  180  -  Sorted  output 

3.  Run  EXTRACT  on  index  word  output  to  produce  input  to  PRNTEXT 

SYS8  -  180  -  Sorted  index  words 
SYS9  - 181  -  Selected  index  words 

4.  Sort  selected  index  words  into  sentence  order 

SYS2  -  181  -  Selected  index  words 
SYSl  - 181  -  Ordered  selected  index  words 

5.  RunPRNTEXT4 

SYS2  -  180  -  SENTFL  input  as  in  1 
SYS8  -  181  -  Ordered  selected  index  words 

3.8  SENTENCE  DICTIONARY  PROCEDURE 

1 .  Run  BPHRAS  to  get  the  phrase  structure  of  the  sentences 
SYS2  -  180  -  SENTFL  input  (from  SENDIC) 

SYS3  -  181  -  phrase  structure  output 
SYS4  -  191  or  192  -  index  word  output 
Run  BPHRAS  for  each  file  desired 
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2.  Sort  as  many  files  of  phrase  structures  together  as  desired  and  within  the  capa¬ 
bility  of  DSORT  and  the  storage  space  available 

SYSl  -  181  -  input 
SYS2  - 180  -  sorted  ou^ut 

3.  Run  DUPPHRAS  on  sorted  phrase  structures 

SYS2  -  180  -  input  from  180  above 
Printer  output 


i 


{ 


f 

) 

i 


i 
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Part  II 

ENGLISH  WORD  GOVERNMENT  DICTIONARY 
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Section  4 
INTRODUCTION 


In  LMSC's  proposal  to  compile  a  word-government  dictionary  (Ref.  7),  the  belief  was 
expressed,  with  demonstrative  examples,  that  a  computer-implemented  word- 
government  dictionary  would  prove  an  invaluable  tool  in  certain  areas  of  computational 
linguistics  and  information  retrieval.  This  project  has  three  objectives:  the  compila¬ 
tion  of  a  dictionary  of  English  word -government  patterns,  the  implementation  of  the 
dictionary  on  a  computer-readable  medium  (probably  magnetic  disk),  and  the  develc^- 
ment  of  a  recognition  algorithm  capable  of  recognizing  government  patterns  in  English 
text  and  assigning  the  pattern  to  the  proper  governing  word. 

Though  some  work  has  been  done  on  the  recognition  algorithm,  the  emphasis  in  the 
past  year  has  been  on  the  actual  compilation  of  the  dictionary  itself. 

4.1  DEFINITION  OF  WORD  GOVERNMENT 

A  governing  word  is  one  which  requires  a  certain  type  of  word,  phrase,  or  construc¬ 
tion  to  complete  its  meaning  (Ref.  8).  Thus,  believe  requires  its  meaning  to  be 
completed  by  a  noun,  or  by  the  prepositional  phrase  beginning  with  in,  or  by  that 
followed  by  a  clause,  or  by  a  clause  alone.  Followng  the  Ramo-Wooldridge  nomen¬ 
clature  (Ref.  9),  the  governing  word  is  called  the  primary.  A  word  or  ease  form 
imposed  by  the  primary  is  called  a  secondary.  Thus,  beUeve  is  a  primary  in  the 
following  sentences:. 

I  believe  him . 

1  believe  in  his  ability. 

I  believe  that  he  will  come. 

I  believe  he  will  come. 
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The  secondaries  are  him,  in  his  ability,  that  he  will  come,  and  he  will  come,  respec¬ 
tively.  Several  secondaries  may  be  associated  with  a  given  primary.  Primaries  are 
nouns,  verbs,  adjectives,  and  occasionally  adverbs.  Secondaries  are  prepositional 
phrases,  certain  case  forms  of  nouns  (especially  important  in  Russian),  and  a  par¬ 
ticular  form  of  the  verb  (e.  g. ,  the  infinitive  form).  It  is  also  possible  for  a  clause  to 
be  a  secondary  element.  Secondaries  may  follow  or  precede  the  primary  and  need  not 
be  contiguous  to  it  or  to  each  other. 

4.2  EXAMPLES  OF  WORD  GOVERNMENT 

In  Table  1,  S  denotes  a  substantive.  If  the  secondary  pattern  contains  more  than  one 
element,  then  the  elements  of  the  pattern  are  separated  by  slashes.  When  secondaries 
occur  on  one  line,  they  are  compatible  with  each  other.  That  is,  they  may  all  occur 
together  in  a  given  sentence.  Secondaries  on  different  lines,  as  with  to  depend,  are 
incompatible.  One  or  the  other,  but  not  both,  may  be  associated  with  their  primary 
in  a  given  sentence. 


Table  1 

GOVERNMENT  EXAMPLES 


Primary 

Secondary 

to  depend 

verb 

on  S/for  S 
upon  S/for  S 
on  S/infinitive 
ipon  S/infinitive 

to  translate 

verb 

s/from  S/into  S 

to  associate 

verb 

S/with  S 

transformation 

noun 

of  s/into  sA>y  s 

immune 

adjective 

to  S 
from  S 

careful 

adjective 

of  S 
with  S 
infinitive 
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Section  5 

FORMAT  OF  THE  DICTIONARY 


The  data  that  make  up  the  word-goverament  dictionary  are  arranged  in  six  columns. 

•  Column  1:  Primary  and  Number  of  Primary  Meanings 

Column  one  contains  the  primary  governing  word  and,  when  applicable,  the  mean¬ 
ing  (denoted  by  a  number)  of  the  pattern  which  follows. 

abide  1  vt  S 

2  Vi  by  S 

3  Vi  in  S/for  S 

The  numbers  1,  2,  and  3  convey  the  fact  that  the  three  patterns  impart  three  dis¬ 
tinct  meanings  to  the  primaiy,  abide.  Abide  (1)  means  "to  tolerate,"  "put  up  with." 
Abide  (2)  means  "to  live  up  to,"  "to  submit  to."  Abide  (3)  means  to  "reside," 

"live,"  "inhabit." 

Occasionally  two  or  more  meanings  are  associated  with  the  same  government 
pattern.  This  fact  is  denoted  by  listing  the  numbers  of  the  various  meanings  side 
by  side 

come  1,2  vi  into  S 

conceive  1,2  vt  S 

2  vi  of  S 

Come  (1)  means  the  ordinary  usage  expressing  motion  into  a  place;  come  (2)  means, 
"to  inherit  something." 

Conceive  (1)  means  "to  become  pregnant  with."  Conceive  (1)  and  conceive  (2)  share 
the  second  meaning,  "to  form  or  develop  in  the  mind;  imagine." 
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At  the  present  stage  of  the  compilation,  the  use  of  meaning-numbers  is  simply  a 
device  to  designate  the  number  of  meanings  which  can  be  assigned  to  a  primary- 
secondary  pair.  The  compilation  of  the  actual  semantic  meanings  associated  with 
primary-secondary  pairs  lies  beyond  the  scope  of  the  present  study. 

•  Column  2;  Parts  of  Speech 

This  column  denotes  the  parts  of  speech  of  the  primary  contained  in  the  first  column. 
The  various  parts  of  speech  have  been  abbreviated  and  it  is  the  abbreviation  which 
occupies  the  second  column, 

n  noun 

ns  noun  singular 

npl  noun  plural 

aj  adjective 

ajp  predicative  adjective 

ajt  post  adjective 

av  adverb 

vt  verb  transitive 

vtl  verb  transitive,  reflexive 

vt2  verb  transitive,  imperative 

vprp  verb,  present  perfective 

ps  past  participle 

vtx  verb  transitive,  does  not  undergo  passive  transformation 

vax  verb  auxiliary 

vtn  verb  transitive,  negative 

vin  verb  intransitive,  negative 

vir  verb  intransit've,  interrogative 

Vi  verb  intransitive 

vip  verb  intransitive,  passive 
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This  list  has  been  ejfpanded  from  the  list  used  in  last  year's  report.  The  secondary 
pattern  (columns  4  through  6)  occims  only  when  its  primary  word  is  in  the  form 
denoted  by  part  of  speech.  The  meanings  of  the  various  parts  of  speech  are  self- 
evident  except  for  those  discussed  below. 

Occasionally  a  verb  has  been  defined  somewhat  more  precisely  than  as  transitive 
or  intransitive. 

1.  Verb  Transitive  Reflexive  (vtl): 

This  verb  is  characterized  by  the  transformation  Vtl  N^-self  Vtl. 
(He  behaved  himself  ^  He  behaved) 

2.  Verb  Transitive  Imperative  (Vt2): 

This  verb  takes  the  object  only  in  the  imperative.  (Beware  the  dog. ) 

3.  Verb  Intransitive  Passive  (Vip); 

This  class  occurs  fairly  often.  The  government  pattern  only  occurs  when 
the  verb  is  passive.  (He  was  chagrined  ^  the  crowd's  behavior. ) 

4.  Verb  Intransitive,  "it"  object  (Vil): 

It  is  an  object  used,  not  as  a  noun  substitute,  but  to  complete  the  verb 
(I  would  appreciate  it  if  you. . . . ). 

5.  Verb  Intransitive,  Reflexive  Pseudo-Object  (Vi2): 

The  reflexive  object  is  a  self-type  of  pronoun  which  agrees  with  the  subject 
in  number  and  gender.  Since  it  cannot  be  replaced  by  another  noun,  it  acts 
to  com;^\ele  the  verb  (he  absented  himself  from  the  house). 

6.  Verb  Intransitive,  Imperative  (Vi3): 

The  government  pattern  occurs  only  in  the  imperative  (Beware  of  the  dog). 

7.  Post  Adjective  (ajt); 

The  adjective  and  its  pattern  may  follow  the  noun  (A  man  likely  to  succeed). 
If  the  adjective  precedes  the  noun,  then  its  pattern  may  "attach"  itself  to 
the  noun  (a  likely  man  to  succeed). 
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•  Columns  3  Through  6:  The  Government  Pattern 

Columns  3  through  6  contain  th<^  heart  of  the  government  dictionary,  the  govern  • 
ment  patterns  themselves.  The  patterns  are  usually  self-ejiplanatcry.  They  should 
be  read  fro’*.'  left  to  right. 

A  pattern  can  contain  anywhere  from  zero  to  four  constituent  elements.  The  most 
common  constituent  by  far  is  a  preposition  followed  by  the  symbol  S  where  S  is  a 
substantive.  Other  abbreviations  are  used  throughout  the  dictionary.  They  are 
listed  in  subsection  A.  1,  Abbreviations. 

Since  the  dictionary  is  to  be  computer-implemented,  certain  conventions  have  been 
adopted  to  facilitate  keypunching.  Thus  the  elements  of  the  patterns  are  arranged 
in  columns  in  the  e^ectation  of  a  fixed-field  iiq)ut  format. 

Also,  a  computer  dictionary,  being  an  argument-function  listing,  cannot  contain 
diplicate  arguments.  Consequently,  orthographically  identical  primaries  have  been 
merged,  the  syntactic  distinction  being  made  in  the  parts -of -speech  column  (column 
2).  Thus  acclaim  has  different  patterns  depending  on  whether  it  is  used  as  a  noun 
or  verb.  The  dictionary  listing  is: 

acclaim  vt  S  /  S 

vt  S  /  as  S 

n  of  S  /  for  S  /  as  S 

Another  computer-imposed  constraint  regarding  primaries  has  to  to  with  the  num¬ 
ber  of  words  in  the  primary.  It  was  decided  to  restrict  primaries  to  a  single  word 
(for  a  more  efficient  dictionary  search).  This  lias  resulted  in  a  somewhat  unnatural 
treatment  of  two-word  primaries  (none  larger  have  been  encountered).  What  has 
been  done  is  to  list  the  first  word  as  the  primary  and  the  second  word  in  the  first 
secondary  column. 

Thus  blowing  over,  a  noun,  is  listed  as 

blowing  n  over  /  of  S 
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There  is  a  group  of  short  common  transitive  verbs  which  allow  the  use  of  a  "floating" 
adverbial  particle  which  may  follow  either  the  verb  or  the  (pro)noun. 

We  backed  up  the  car. 

We  backed  the  car  up. 

He  took  off  his  coat. 

He  took  his  coat  off. 

These  are  actually  two-word  transitive  verbs  subject  to  the  transformation 

N^V^AvNg^tN.V^N^Av 

and  must  be  distinguished  from  intransitive  verbs  with  prepositional  phrases. 

This  type  of  two -word  primary  is  treated  in  the  dictionary  by  placing  the  first  word 
in  the  primary  column  and  the  adverb,  preceded  by  a  slash  (/),  in  the  first  second¬ 
ary  column. 


Thus 


carry  vt  /out  S 


These  verbs  are  quite  common.  They  are  also  important  because  the  adverbs  are 
often  used  to  distinguish  meaning. 


Occasionally  a  zero  occurs  in  the  first  secondary  column.  This  indicates  that  iw 
pattern  can  occur  with  the  primary  in  question  (or,  as  below,  the  meaning  of  the 
primary  iu  question) 

amusement  1  n  0 

2  n  of  S  /  at  S 

amusement  (1)  is  "something  that  amuses  or  entertains,"  while  amusement  (2)  is 
"an  amusing  or  being  amused."  This  pattern,  or  more  accurately  lack  of  pattern, 
is  easy  to  miss.  The  entire  dictionary  when  completed  should  be  re-examined 
specifically  for  this  pattern. 
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When  a  dash  occurs  as  one  of  the  secondary  elements  it  means  that  the  primary 
itself  is  to  be  substituted  for  the  dash.  Two  dashes  indicate  an  inflected  form  of 
the  primary  may  be  substituted 

chance  vi  it/-  -/that  +  cl 

It  chanced  that  we  were  there  when  the  accident  occurred. 

A  clause  preceded  by  that  is  denoted  by  that  +  cl .  It  occurs  quite  often. 

A  jther  common  occurrence  is  CJ+  d;  CJ does  not  stand  for  a  conjunction  but  for 
a  s^  of  words  called  conjunctives.  These  are  words  like  how,  what,  who,  etc. 
(See  subsection  A.  1  for  complete  list. ) 


The  elements  listed  in  the  abbreviations  can  often  oe  combined  to  form  larger  units. 


confront  vt  S/with  CJ  +  cl; 
We  confronted  him  with 


(what  he  had  said 
how  he  had  behaved 


This  pattern  must  be  examined  in  more  detail  because  often  not  all  conjunctives  can 
be  used  in  the  pattern. 


There  are  two  kinds  of  infinitives ,  the  "to"  infinitive  denoted  by  "to~inf "  aud  the 
so-called  bare  infinitive  (I  saw  the  dog  cross  the  road)  which  is  an  infinitive  without 
'*to"  denoted  in  the  dictionary  as  "bare-inf ." 

When  a  word  is  enclosed  by  parentheses ,  its  use  is  optional 


cause  vt  S/(not)to-inf 
We  caused  him  (not)  to  win  the  election. 


Sometimes  to  be  is  part  of  a  secondary  pattern. 

caution  vt  S/to-be  A 
We  cautioned  the  children  to  be  careful . 
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Appendix  A 

WORD  GOVERNMENT  DICTIONARY 


A.  1  ABBREVIATIONS  AND  SPECIAL  SYMBOLS 

Abbreviations 

The  following  abbreviations  are  used  to  describe  secondary  patterns  in  the  dictionary 
Abbreviation  Meaning 


s 

substantive 

N 

noun 

CN 

noun  plural 

NM 

noun  animate 

A 

adjective 

D 

adverb 

DT 

adverbial  time  expression 

DJ 

adverbial  adjunct 

P 

pronoun 

PX 

pronoun  reflective 

PSS 

pronoun  possessive 

G 

gerund 

PS 

past  participle 

PR 

present  participle 

VRB 

verb 

cl 

clause 

to-inf 

"to"  infinitive  (to  see,  to  go 

bare -inf 

infinitive  without  "to" 
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CJ 


conjunctive;  that  is,  one  of  the  following, 

how,  what 
when,  where 
who,  whom 
whose,  why 
whether,  if 

phrs  phrase 

to-be  the  verb  "to  be" 


jecial  Symbols 


Symbol  Definition 

(  )  Whatever  is  contained  within  the  parentheses 

is  optional  in  the  government  pattern. 

n  "not" 

+  The  stricture  following  the  "  +  "  requires 

analysis  by  parsing  program  (e.g. , 
that  +  clause) 

Substitute  the  primary  for  the  "  -  " 

Substitute  an  inflected  form  of  the  primaiw 
for  "  — " 
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A. 2  DICTIONARY 


&b«&dc$D 

a 

of  9 

aeesisftAloA 

1 

a 

of  8 

vt 

SAo  1 

2 

A 

of  SArott  8/tc  9/ta  8 

ft 

S/for  S 

2 

A 

of  8/ttS 

ftbAadoaioMt 

D 

of  SAo  S/bf  3 

Aocaisrats 

1 

Vt 

9 

B 

of  S/for  S/bjr  8 

2 

vt 

S/froa  8/to  S/La  S 

2 

vt 

S/atS 

tbbrwliM 

Vt 

SAo  3 

aoesm 

a 

of  8,^ob8 

stbbrtrlallaB 

1 

a 

of  S/to  8 

vt 

S 

2 

a 

for  8 

Aoeopt 

1 

vt 

8/fcr  S 

abdleau 

vt 

S 

2 

vt 

S/lato  8/aa  8 

vl 

from  S 

2 

Vi 

8/ta  8/aa  8 

tbdictflcm 

a 

of  S/bf  S 

aaospAabiUty 

1 

a 

of  8/for  9 

a 

of  S/(ro«  8 

2 

a 

of  8/tato  8/aa  S 

2 

a 

of  8/ta  S/aa  S 

Abduct 

vt 

S/froKi  9 

aaosf«Alc>U 

Aj 

to  SAor  8 

Abductloe 

a 

of  SArosa  8/bjr  8 

Al 

to  8/as  8 

AbborTAACt 

a 

of  S/Al  8 

aoospUacA 

I 

a 

of  8/for  S 

a 

of  S/SfAiASt  8 

2 

a 

of  8/itito  S/as  S 

2 

a 

of  8/la  8/as  S 

Abhorrattt 

A] 

to  S 

Aoesaa 

a 

of  0/to  8/by  S 

ANdiAOA 

a 

of  SAv  9 

vt 

8 

AbtdA 

i 

vt 

9 

aoossAAry 

ai 

to  S 

2 

vl 

by  S 

3 

vl 

La  S/for  S 

Aoosaetbillty 

a 

of  S/to  8/by  S 

AbUltjr 

B 

of  SAo  -la£ 

Aaosaslbis 

A} 

to  S/by  8 

Abie 

AJ 

to  *LaI 

aoesAAory 

A) 

to  8 

AboorniAUty 

a 

of  S/LaS 

Aoetdsm 

a 

At  S 

a 

laS 

AboUeh 

•t 

S/frosQ  S 

Q 

OD  8 

vt 

S/la  9 

a 

UpOB  8 

a 

by  8 

AboUehiDeiA 

of  S/from  SAiy  3 

a 

of  S/la  S/by  9 

ACClAia 

Vl 

S/8 

vt 

S/as  $ 

Abolltloa 

a 

of  S/froB  SAiy  S 

a 

of  S/for  9/as  S 

a 

of  S/la  S/by  S 

ACC  li  nuts 

vt 

SAo  8 

AbomlAMlcti 

a 

to  S 

vt 

SAo  -laf 

Aboufid 

1 

vt 

la  3 

AOClUAAdOD 

a 

of  S/to  S 

2 

vl 

wltb  S 

a 

of  8/to  *l4f 

Abecood 

vt 

wttbS 

*ocomoK>dAfs 

1 

vt 

SAo  8/by  8 

2 

vt 

8/wltb  8 

Abeeace 

1 

a 

of  S/froa  S 

3 

vt 

S/At  8 

2 

a 

of  S/la  S 

3 

vt 

SAaS 

AhMOt 

vl2 

Pa/froa  S 

AooocamodAUcB 

1 

a 

o'  b/to  S/by  S 

Al 

from  9 

2 

a 

of  S/attb  S 

2 

a 

bstwsoB  S/aad  S 

AhAoiuUQB 

1 

a 

of  S/Crom  9/by  S 

2 

a 

of  8/Aod  9 

2 

o 

of  S 

3 

a 

of  8/At  8 

3 

a 

of  8/1b  S 

Absolve 

vt 

S/from  9 

vt 

S/of  S 

AeconpAAlmsat 

1 

a 

of  o/to  S 

2 

a 

of  S/vtlb  3 

Absorb 

1 

vt 

S/from  S/lato  9/by  9 

3 

a 

of  8/oa  S 

2 

vl 

S 

3 

vtp 

la  8 

AseompAay 

1 

vt 

SAo  9 

3 

vtp 

wttbS 

2 

vt 

S/wttb  9 

3 

rip 

loto  S/tbroufb  9 

3 

vt 

9/oo8 

AbsorptloQ 

1 

a 

of  S/frocD  S/tato  S/b)  9 

ACCompUr* 

a 

of  S/la  8 

2 

0 

of  S/ta  9 

a 

to  9 

2 

a 

of  9/wltb  S 

Aooord 

1 

A 

9/8 

AbstAba 

vt 

from  S 

1 

vt 

SAo  9 

2 

vl 

eitb  8 

Abstsatioa 

0 

of  9/frora  S 

a 

of  8/wttb  S 

a 

bscweea  S/aad  8 

AbsOfimos 

0 

of  S/from  8 

AocordsAos 

1 

a 

of  BAo  9 

AbstTACt 

n 

8/fram  8 

2 

a 

of  8/»tUi  8 

2 

a 

bstweea  S/aad  S 

Accede 

vt 

to  9 

A«oordyf 

A) 

AS  ♦  ei 

Aj 

to  8 
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itccovat 

\ 

vt 

8/A  MfcpUNltty 

a 

of  SAo  S/for  S 

a 

Tl 

tG  8Aor  S 

3 

Vi 

(or  8  arfd 

1 

vt 

8/oato  S 

1 

vt 

SAo  8 

1 

• 

ol8/toS 

2 

vl 

tc  5 

a 

e 

oiS/at  8 

3 

vl 

up  to  8 

a 

B 

oi  s/wita  s 

MUiet 

vt 

8/to  8 

•oeottotabditjr 

h 

of  S/to  8/for  8 

adMettoa 

a 

of  8/to  8 

•ooouaUfaU 

aj 

to  8/lor  8 

artrtlBoa 

a 

of  8/to  8 

Aocradlt 

vt 

S/to  8 

a 

of  t/aadS 

vt 

SAo  >laf 

a 

of  8/oefo  9 

ft 

8/at  a 

vt 

8/vltk  8  addraaa 

1 

vt 

SAo  8 

3 

vt 

8/aa  8 

•ccrvtlaa 

a 

of  SAo  S/bf  S 

a 

of  8/at  8 

1 

a 

of  S/la  8 

a 

of  S/oa  8 

a 

a 

of  SAo  8 

a 

of  a/laS 

adoft 

a 

BtS 

MCnM 

vt 

8/La  S/at  8 

e 

laS 

vl 

to  8/la  S/it  S 

a 

WltbS 

vl 

to  S/Iroa  3 

aj 

■t  8 

vl 

to  a/b)r  8 

AJ 

laS 

a) 

WltbS 

MR'iAuUU 

vt 

SAaS 

vt 

8/at  8  arta<pitta 

*i 

for  1 

•i 

toS 

•ocuntulAtioB 

a 

of  S/la  S/by  3 

atS 

a 

of  8/at  S/fay  8 

hi 

laB 

aj 

to  -laf 

aocMjraU 

1 

•J 

to  8 

a 

aj 

la  8  aAara 

1 

vt 

S/toS 

2 

vl 

to  8 

•C«UlllClOB 

e 

of  S/acaloac  3 

adMraoeo 

a 

of  8/U>9 

AOeUM 

vt 

8/of  8 

adjaoaat 

aJ 

to  8 

ftocuMon 

vt 

S/to  8 

vt 

SAo  -ijrf  adjola 

vt 

SAoS 

AOhi«T« 

vt 

S/La  8/by  8  adora 

vt 

S/wltb  S 

•Cltl^TMBOTi 

0 

of  S/la  S/by  S  ad)oura 

1 

vt 

S/uatUS 

1 

vt 

SAor  S 

ftckBOwUdc* 

vt 

S/S 

2 

vt 

SAo  8 

vt 

8/aa  S 

adiouramant 

1 

a 

of  S/ubOI  9 

tdOMwltdfidMt 

a 

of  S/aa  8/by  S 

1 

a 

of  8Aor  S 

2 

a 

of  8/to  8 

•oquaiM 

1 

vt 

8/wtth8 

a 

vt 

S/tbit  *  d  adjuaoc 

a 

to  8 

■oqualnUao* 

0 

of  S/wlth  8  ad)uat 

vt 

SAo  8 

•oqiUatoa 

n 

to  S/la  8  adjaataaoet 

a 

of  8/to  8 

iwntlaao— cf 

a 

of  8/to  S/la  8  adnlatatar 

1 

vt 

8 

Z 

vt 

8Ao8 

•oquir* 

vt 

8/froa  8/(or  S/by  8 

3 

vl 

toS 

itoquirwoMt 

n 

of  8/froo  S/for  S/by  8  Mkalrvdoo 

a 

of  BAor  8 

adi^ttloa 

a 

of  SAroiB  3/(or  S/by  9  athalro 

ft 

8Aor  8 

1 

via 

S/«Ub  S  admiaatoD 

1 

a 

of  8/ta«o  P 

a 

vt 

8/of  8 

1 

a 

of  9Ao8 

Z 

■ 

of  8/to  8/tbat  *  cl 

•oquital 

a 

of  SAor  S/by  8 

8 

a 

d 

t&t 

1 

vl 

Q«  8  adaU 

1 

vt 

S/lato  8 

a 

vl 

la  8 

1 

vt 

S/to  8 

1 

vt 

to8/tb«t  *  ci 

Mtloa 

1 

a 

of  S/oa  8 

2 

vl 

cl 

a 

a 

of  8/la  8 

aAnlttapoo 

a 

of  S/U£o  8 

totiv* 

aJ 

la  8 

a 

of  8/loS 

a) 

wltbS 

«J 

at  8  admoalah 

rt 

8/ifalaat  8 

aJ 

fora 

A 

8Aot  8 

vt 

8Ao  'Izif 

•dH« 

vt 

8/to  fl/for  8 

rip 

for  9  ■teoatttoo 

a 

of  S/affiaat  8 

a 

of  S/for  8 

■dapeailOB 

a 

of  8/to  8/!or  8 

a 

of  8/to  'laf 
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1 

SAoi 

1 

n 

(Aoward  f 

1 

vt 

f/Ueo8 

1 

▼t 

M/m  S/£r««  S 

1 

«t 

8/upce  8 

1 

Tt 

S/i^pUai4  S 

2 

Vt 

8Ar«ai  S/w  M/ov«r  S 

1 

• 

olS/9»8 

1 

B 

of  MAuvartl  8 

1 

a 

of  S/UitoS 

1 

c 

of  8/oa  t  ^trdMi  S 

1 

• 

of  B/upoa  S 

1 

a 

of  8/afalaoS  f) 

1 

9 

8^  8/OT«f  8 

3 

a 

ua 

•dnMOvmMt 

a 

of  S/tras  8/to  Vovrr  8 

•dvMCaf* 

a 

of  a/omr  C 

a 

of  8/108 

airtsUftoiu 

tj 

CO  S 

«J 

2or  a/to  'Ui 

ad<r«rttM 

1 

n 

MAoS 

3 

ft 

8/U8 

1 

▼1 

for  a/UB 

adrvrtUtiMM 

1 

a 

c/3Au8 

2 

a 

of  S/ifi  8/for  3 

whrlo* 

froca  S/to  8/cv  S 

e 

of  S/to  3/aa  3 

■driMblA 

ttj 

to  'laf 

•j 
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